-- Logs begin at Thu 2022-05-26 02:14:51 UTC, end at Thu 2022-05-26 03:44:26 UTC. -- May 26 03:03:00.667705 dv-cinder-843361-1-smb systemd[1]: Starting Devstack devstack@keystone.service... May 26 03:03:00.676348 dv-cinder-843361-1-smb devstack@keystone.service[80602]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 03:03:00 2022] *** May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: nodename: dv-cinder-843361-1-smb May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: machine: x86_64 May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: clock source: unix May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: pcre jit disabled May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: detected number of CPU cores: 4 May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: current working directory: / May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: detected binary path: /usr/bin/uwsgi-core May 26 03:03:00.678366 dv-cinder-843361-1-smb devstack@keystone.service[80602]: your processes number limit is 47680 May 26 03:03:00.679058 dv-cinder-843361-1-smb devstack@keystone.service[80602]: your memory page size is 4096 bytes May 26 03:03:00.679058 dv-cinder-843361-1-smb devstack@keystone.service[80602]: detected max file descriptor number: 2048 May 26 03:03:00.679058 dv-cinder-843361-1-smb devstack@keystone.service[80602]: lock engine: pthread robust mutexes May 26 03:03:00.679058 dv-cinder-843361-1-smb devstack@keystone.service[80602]: thunder lock: enabled May 26 03:03:00.679058 dv-cinder-843361-1-smb devstack@keystone.service[80602]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 03:03:00.679058 dv-cinder-843361-1-smb devstack@keystone.service[80602]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 03:03:00.724060 dv-cinder-843361-1-smb devstack@keystone.service[80602]: Python main interpreter initialized at 0x55995cc769c0 May 26 03:03:00.724060 dv-cinder-843361-1-smb devstack@keystone.service[80602]: python threads support enabled May 26 03:03:00.724060 dv-cinder-843361-1-smb devstack@keystone.service[80602]: your server socket listen backlog is limited to 100 connections May 26 03:03:00.724060 dv-cinder-843361-1-smb devstack@keystone.service[80602]: your mercy for graceful operations on workers is 90 seconds May 26 03:03:00.724463 dv-cinder-843361-1-smb devstack@keystone.service[80602]: mapped 403077 bytes (393 KB) for 2 cores May 26 03:03:00.724540 dv-cinder-843361-1-smb devstack@keystone.service[80602]: *** Operational MODE: preforking *** May 26 03:03:00.724794 dv-cinder-843361-1-smb devstack@keystone.service[80602]: *** uWSGI is running in multiple interpreter mode *** May 26 03:03:00.724794 dv-cinder-843361-1-smb devstack@keystone.service[80602]: spawned uWSGI master process (pid: 80602) May 26 03:03:00.725002 dv-cinder-843361-1-smb systemd[1]: Started Devstack devstack@keystone.service. May 26 03:03:00.725768 dv-cinder-843361-1-smb devstack@keystone.service[80602]: spawned uWSGI worker 1 (pid: 80614, cores: 1) May 26 03:03:00.725900 dv-cinder-843361-1-smb devstack@keystone.service[80602]: spawned uWSGI worker 2 (pid: 80615, cores: 1) May 26 03:03:00.727283 dv-cinder-843361-1-smb devstack@keystone.service[80602]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 03:03:06.326802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 03:03:06.326802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: from cryptography.utils import int_from_bytes May 26 03:03:06.327563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 03:03:06.327563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: from cryptography.utils import int_from_bytes May 26 03:03:06.349044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 03:03:06.349044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: from cryptography.utils import int_from_bytes May 26 03:03:06.349536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 03:03:06.349536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: from cryptography.utils import int_from_bytes May 26 03:03:06.376871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 03:03:06.377060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 03:03:06.377250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] command line args: [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 03:03:06.377516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 03:03:06.377691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ================================================================================ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 03:03:06.377948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] admin_token = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.378190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config_dir = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.378373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.378551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config_source = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.378727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] debug = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.378930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.380329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.380329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.380329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.380329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.380329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.380329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_config_append = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.380703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.380703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_dir = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.380846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.381091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.381320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.381563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.381805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.381981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.382172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.382400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.382642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.382873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.383102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.383329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.383558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.383800 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.384042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.384334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.384815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.384993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] publish_errors = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.385219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.385443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.385626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.385857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.386092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.386324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] standard_threads = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.386550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.386787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.386960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.387133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_journal = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.387305 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_json = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.387476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_stderr = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.387647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_syslog = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.387873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.388123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.388382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.388642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.388877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.389139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.389355 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.389599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.389831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.390075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.390318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.390563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.390792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.391036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.391267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.391510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.392294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.392556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.392809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.393060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.393301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.393535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.393783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.394039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.394288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.394533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.394762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.394989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.395216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.395447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.395692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.395823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 03:03:06.395935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.396020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 03:03:06.396161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.396241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] command line args: [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 03:03:06.396414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.396505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 03:03:06.396656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ================================================================================ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 03:03:06.396729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.396889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] admin_token = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.396972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.397120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.397209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] config_dir = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.397308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.397391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.397490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] config_source = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.397568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.397667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] debug = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.397796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.397875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.398028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.398119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.398255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.398345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.398481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.398558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.398706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.398784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.398931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.399024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.399125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_config_append = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.399202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.399302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.399386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.399478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_dir = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.399605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.399685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_file = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.399837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.399921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.400062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.400139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.400292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.400407 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.400544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.400622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.400771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.400855 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.400938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.401016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.401184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.401262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.401429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.401586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.401714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.401837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.401954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.402075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.402191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.402317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.402435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.402549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.402663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.402777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.402891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.403013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.403128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.403241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.403357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.403481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.403598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.403721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.403837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] publish_errors = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.403957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.404079 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.404203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.404338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.404338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.404556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.404675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.404807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.404936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.405053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.405182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] standard_threads = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.405299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.405413 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.405533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.405657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.405779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.405901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.406022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.406138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_journal = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.406138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_json = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.406362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.406479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_stderr = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.406594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.406708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_syslog = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.406821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.406934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 03:03:06.407056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.407189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.407416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.408968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.409085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.409206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.409330 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.409436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.409550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.409675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.409793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.409920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.410045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.410162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.410278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.410394 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.410517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.410624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.410738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.410854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.410958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.411079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.411204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.411322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.411437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.411552 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.411673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.411790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.411904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.412020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.412134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.412249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.412381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.412508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.412636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.412754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.412754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.412971 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.413086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.413209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.413335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.413452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.413452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.413669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.413791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.413908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.external = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.413908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.414204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.414204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.414419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.414535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.414651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.414774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.414891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.password = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.415008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.415123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.token = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.415242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.415359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.415483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.415606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.415606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.415831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.415948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.416064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.416188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.416359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.416478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.416594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.416720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.416844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.416978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.417109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.417227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.417343 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.417459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.417575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.417575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.417799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.417916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.418021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.418119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.418214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.418214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.418510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.418510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.418741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.418891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.418997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.419094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.419201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.419316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.419421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.419520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.419623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.419729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.419837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.419936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.420033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.420140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.420244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.420361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.420476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.420583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.421025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.421153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.421273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.421388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.421513 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.421631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.421754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.421871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.421988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.422110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.422236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.422355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.422471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.422593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.422724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.422843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.423450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.423571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.423687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.423803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.423918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.424034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.424159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.424282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.424459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.424580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.424681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.424778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.424875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.424972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.425984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.426987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.427084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.427202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.427319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.427436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.427628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.427748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.427865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.427989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.428108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.428233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.428376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.428494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.428593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.428706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.428804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.428911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.429012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.429109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.429241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.429362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.429362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.429588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.429708 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.429831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.429948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.430070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.430070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.430301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.430419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.430535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.430658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.430777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.430894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.431996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.432220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.432382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.432506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.432607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.432705 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.external = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.432803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.432899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.password = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.token = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.433984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.434981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.435985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.436098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.436198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.436295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.436415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.436521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.436643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.436774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.436892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.436892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.437111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.437226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.437372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.437501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.437626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.437744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.437860 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.437976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.438094 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.438219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.438337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.438461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.438614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.439237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.439355 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.439483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.439602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.439719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.439836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.439961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.440088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.440208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.440389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.440510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.440676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.440914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.441168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.441337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.441583 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.441704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.441821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.441936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.442062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.442181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.442300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.442416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.442532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.442649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.442774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.442892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.443010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.443126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.443242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.443360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.443485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.443605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.443722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.443846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.443964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.444081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.444205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.444343 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.444463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.444591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.444699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.444815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.444940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.445059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.445176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.445292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.445410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.445525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.445653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.445771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.445888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.446004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.446121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.446239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.446364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.446484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.446600 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.446717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.446833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.446950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.447074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.447193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.447193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.447412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.447529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.447645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.447773 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.447892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.448008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.448123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.448240 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.448385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.448385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.452392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.452527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.452648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.452768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.452886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.453020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.453141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.453259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.453376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.453493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.453610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.453736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.453856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.453973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.454090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.454207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.454324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.454506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.454627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.454745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.454870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.454989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.455115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.455234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.455351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.455468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.455588 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.455706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.455706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.455938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.456056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.456173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.456290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.456423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.456552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.456672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.456795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.456915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.457032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.457149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.457274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.457392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.457510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.457626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.457744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.457860 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.457987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.458106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.458223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.458339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.458456 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.458572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.458701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.458820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.458937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.459055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.459172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.459288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.459417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.459536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.459653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.459769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.459885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.460002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.460002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.460234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.460404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.460523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.460640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.460756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.460756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.460991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.461109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.461225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.461225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.461443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.461569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.461687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.461805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.461805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.462022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.462139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.462265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.462384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.462501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.462618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.462735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.462851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.462976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.463095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.463213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.463330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.463447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.463564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.463689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.463808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.463925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.464041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.464167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.464296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.464430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.464560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.464679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.464797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.464914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.465031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.465031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.465263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.465384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.465502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.465622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.465740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.465856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.465982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.466101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.466218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.466335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.466452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.466829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.466956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.467075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.467193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.467309 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.467428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.467545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.467671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.467790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.467907 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 03:03:06.468786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.468786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.469816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] role.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.469816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] role.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.469816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.469816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.469816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.469816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.469816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.469816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.469816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.470793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.470793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.470793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.470793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.470793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.470793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.470793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.470793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.470793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.471739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.471739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.471739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.471739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.472156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.472156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.476322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.476322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.476322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.476322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.476322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.476322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.476322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.476322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.476322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.477279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.477279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.477279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.477279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.477279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.477279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.477279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.477279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.477279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.478228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.478228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.478228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.478228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.478228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.478228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.478228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.478228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.479123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.479123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.479123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.479123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.479561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.479687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.479805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.480051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.480289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.480591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.480831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.481069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.481315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.481552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.481795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.482030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.482277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.482514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.482756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.482987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.483226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.483461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 03:03:06.483630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 03:03:06.495594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.495824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.496048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.505290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.509746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.509979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.510209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.520386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.533543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.533777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.538957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.539188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.587233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.587403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.639811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.640020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.640095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.640158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.707533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.707760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.707872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.707984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.708070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.708202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.708285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.708542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.708621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.708696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.708770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.708917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.732373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.732493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.732629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.732718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.732836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.732921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.733060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.733148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.733273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.733355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.733485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.733576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.733695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.733778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.745505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.745838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.757983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.758236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.758322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.758457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.758540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.758673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.758765 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.758885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.758969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.759097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.759180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.759309 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.759392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.759521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 03:03:06.777042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.777250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 03:03:06.777584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.777783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 03:03:06.778043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.778236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.778319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.778449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 03:03:06.778540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.778770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.778853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.778967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 03:03:06.779230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.779485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.779739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.779991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.790426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.790701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.790964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.791242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.793417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.793695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.793968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.794247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.800375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.802993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.803169 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.803443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.803720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.803997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.804274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.804559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.804934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.805207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.805477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.805742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.806002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.806296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.806575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.806855 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.807134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.807412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.807785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.808054 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.808345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.808615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.808887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.809152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.832109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.833848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.834125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.835367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.837102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.837422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.839349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.839625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.839901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.842912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.843190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.843468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.848106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.848412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.851256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.851535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.852863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.853258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.853535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.853812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.854083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.854354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.854619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.854882 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.855989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.856419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.856701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.856979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.857253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.857527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.857797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.858064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.873869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.874140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.877100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.877378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.878813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.881997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.882422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.882710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.885674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.885969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.888095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.891033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.891692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.894683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.895441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.895734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.896018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.896321 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.896603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.896877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.898437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.898742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.899028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.899320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.899610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.899897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.916104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.916408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.916672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.916929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.919234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.919517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.919785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.920046 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.925433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.927127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.927398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.928622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.930335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.930421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.930610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.930693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.930948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.931224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.931498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.933660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.933944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.934222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.934499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.934773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.944915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.945190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.945474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.945756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.946031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.946301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.946579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.948186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.948485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.948767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.949053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.949333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.949603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.949884 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.964456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.967933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.968022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.971766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.971860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.973404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.975016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.975099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.975296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.975575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.976748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.978362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.978648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.978942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.982898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.984519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.986876 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.988333 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.988499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.988632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.988910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.989182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.991723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.992010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.992289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.992619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.998227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:06.998509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:06.998885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.001764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:07.002050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.002433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.006714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:07.006990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.007264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.007536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.007802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.008068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.008364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.008644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.008917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.009181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.009443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.009694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.009958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.010225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.010305 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 03:03:07.010583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.010858 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.011131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.011399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.011669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.011939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.012218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.012508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.012793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.013067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.013325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.013584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.013846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 03:03:07.049399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55995cc769c0 pid: 80614 (default app) May 26 03:03:07.052623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10d0a-9bc1-4a2c-aa66-e6f2cf25113e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:07.052918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10d0a-9bc1-4a2c-aa66-e6f2cf25113e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:07.053176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55995cc769c0 pid: 80615 (default app) May 26 03:03:07.053259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10d0a-9bc1-4a2c-aa66-e6f2cf25113e None None] PATH_INFO: `/v3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:07.057442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu May 26 03:03:07 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:15.957053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655d83-2b1c-4b71-a7d1-257f059c0336 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:15.957601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655d83-2b1c-4b71-a7d1-257f059c0336 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:15.957601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655d83-2b1c-4b71-a7d1-257f059c0336 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:15.962156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:15.976163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:15.976163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:15.976163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:16.036607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: INFO dbcounter [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] Registered counter for database keystone May 26 03:03:16.058233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG oslo_db.sqlalchemy.engines [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 03:03:16.064901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writer thread running {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 03:03:16.236370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG passlib.handlers.bcrypt [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80614) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 03:03:16.236790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG passlib.handlers.bcrypt [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80614) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 03:03:16.292173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:16.293790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:16.415028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 26 03:03:16.585145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655d83-2b1c-4b71-a7d1-257f059c0336 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:16.652816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: INFO dbcounter [None req-97655d83-2b1c-4b71-a7d1-257f059c0336 None None] Registered counter for database keystone May 26 03:03:16.671864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG oslo_db.sqlalchemy.engines [None req-97655d83-2b1c-4b71-a7d1-257f059c0336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 03:03:16.678135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writer thread running {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 03:03:16.798626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655d83-2b1c-4b71-a7d1-257f059c0336 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:16.802983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae169bd-cb73-4023-80ef-3787cf711f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:16.803664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae169bd-cb73-4023-80ef-3787cf711f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:16.803954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae169bd-cb73-4023-80ef-3787cf711f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:16.804236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae169bd-cb73-4023-80ef-3787cf711f79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:16.812683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae169bd-cb73-4023-80ef-3787cf711f79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:16.865695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3ae169bd-cb73-4023-80ef-3787cf711f79 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 03:03:16.866047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae169bd-cb73-4023-80ef-3787cf711f79 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:16.876514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu May 26 03:03:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:03:16.882507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:16.896708 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48e8ba-92fc-40d4-bf42-7f31e6bec54b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:16.901129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eb0ef-b4ea-4233-a262-ec81447e7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:16.902230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb0ef-b4ea-4233-a262-ec81447e7af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:16.902515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb0ef-b4ea-4233-a262-ec81447e7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:16.902799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb0ef-b4ea-4233-a262-ec81447e7af6 admin admin] PATH_INFO: `/v3/projects/2bc9d186e27441d983463d38b1cc22e5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:16.904489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eb0ef-b4ea-4233-a262-ec81447e7af6 admin admin] RBAC: Authorizing `identity:get_project(project_id=2bc9d186e27441d983463d38b1cc22e5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:17.062087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea5eb0ef-b4ea-4233-a262-ec81447e7af6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 03:03:17.062747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eb0ef-b4ea-4233-a262-ec81447e7af6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:17.067710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu May 26 03:03:16 2022] GET /identity/v3/projects/2bc9d186e27441d983463d38b1cc22e5 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:19.204176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7301e-79a1-43a5-84a9-e852d956180a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:19.204716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7301e-79a1-43a5-84a9-e852d956180a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:19.204716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7301e-79a1-43a5-84a9-e852d956180a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:19.208803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:19.214232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20e262-3b49-4639-885b-682706a10c5a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:19.214643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20e262-3b49-4639-885b-682706a10c5a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:19.214796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20e262-3b49-4639-885b-682706a10c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:19.233557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ff20e262-3b49-4639-885b-682706a10c5a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:19.235562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ff20e262-3b49-4639-885b-682706a10c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:19.243346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 03:03:19.265994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7301e-79a1-43a5-84a9-e852d956180a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:19.278299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7301e-79a1-43a5-84a9-e852d956180a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:19.282507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c48da-1361-4b01-bc05-be4234c449c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:19.283136 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c48da-1361-4b01-bc05-be4234c449c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:19.283423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c48da-1361-4b01-bc05-be4234c449c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:19.283703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c48da-1361-4b01-bc05-be4234c449c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:19.291360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c48da-1361-4b01-bc05-be4234c449c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:19.293181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c48da-1361-4b01-bc05-be4234c449c2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:19.302372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu May 26 03:03:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:03:19.307440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20e262-3b49-4639-885b-682706a10c5a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:19.316814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20e262-3b49-4639-885b-682706a10c5a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:19.321123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a247c61-326f-4e6f-9dd3-0603c406934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:19.321971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a247c61-326f-4e6f-9dd3-0603c406934a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:19.322251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a247c61-326f-4e6f-9dd3-0603c406934a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:19.322523 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a247c61-326f-4e6f-9dd3-0603c406934a admin admin] PATH_INFO: `/v3/users/5700cdd86bd44b43a6a74ec88a185c9c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:19.323885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a247c61-326f-4e6f-9dd3-0603c406934a admin admin] RBAC: Authorizing `identity:get_user(user_id=5700cdd86bd44b43a6a74ec88a185c9c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:19.325731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a247c61-326f-4e6f-9dd3-0603c406934a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:19.327247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu May 26 03:03:19 2022] GET /identity/v3/users/5700cdd86bd44b43a6a74ec88a185c9c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:21.542875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c010-fc77-4d15-bfc6-9bae76bff061 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:21.543408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c010-fc77-4d15-bfc6-9bae76bff061 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:21.543511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c010-fc77-4d15-bfc6-9bae76bff061 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:21.544899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:21.550121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee00a3-e77f-4770-827f-764458383f97 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:21.550539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee00a3-e77f-4770-827f-764458383f97 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:21.550672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee00a3-e77f-4770-827f-764458383f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:21.566874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0aee00a3-e77f-4770-827f-764458383f97 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:21.568031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0aee00a3-e77f-4770-827f-764458383f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:21.591303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31e0a-0e33-40f7-ad2d-bdcc12b8f472 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:21.591596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31e0a-0e33-40f7-ad2d-bdcc12b8f472 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:21.591879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a31e0a-0e33-40f7-ad2d-bdcc12b8f472 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:21.593249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:03:21.598802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fbb43-6797-442e-8dc4-98b81f8578a8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:21.599091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fbb43-6797-442e-8dc4-98b81f8578a8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:21.599377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fbb43-6797-442e-8dc4-98b81f8578a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:21.638218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG passlib.handlers.bcrypt [None req-bb3fbb43-6797-442e-8dc4-98b81f8578a8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80615) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 03:03:21.638648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG passlib.handlers.bcrypt [None req-bb3fbb43-6797-442e-8dc4-98b81f8578a8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80615) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 03:03:21.647857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:21.671312 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee00a3-e77f-4770-827f-764458383f97 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:21.685684 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bb3fbb43-6797-442e-8dc4-98b81f8578a8 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:21.687280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bb3fbb43-6797-442e-8dc4-98b81f8578a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:21.694467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:21.774580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee00a3-e77f-4770-827f-764458383f97 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:21.788354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:21.808390 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fbb43-6797-442e-8dc4-98b81f8578a8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:21.809878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e46ec-1033-451f-9957-83393404cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:21.810676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e46ec-1033-451f-9957-83393404cd20 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:21.810962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e46ec-1033-451f-9957-83393404cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:21.811245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e46ec-1033-451f-9957-83393404cd20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:21.823181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e46ec-1033-451f-9957-83393404cd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-217e46ec-1033-451f-9957-83393404cd20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:21.835040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:21.835915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:21.836756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:03:21.842091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e46ec-1033-451f-9957-83393404cd20 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:21.911057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fbb43-6797-442e-8dc4-98b81f8578a8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:21.913349 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:21.920988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:21.938601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e46ec-1033-451f-9957-83393404cd20 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:21.947893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aa6e3-a8b2-4a86-a163-b39a1232f2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:21.949188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aa6e3-a8b2-4a86-a163-b39a1232f2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:21.949475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aa6e3-a8b2-4a86-a163-b39a1232f2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:21.949757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aa6e3-a8b2-4a86-a163-b39a1232f2a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:21.972501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3eb54-caf0-4cf7-be0e-0898dbf527bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:21.973158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3eb54-caf0-4cf7-be0e-0898dbf527bd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:21.973440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3eb54-caf0-4cf7-be0e-0898dbf527bd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:21.973712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3eb54-caf0-4cf7-be0e-0898dbf527bd None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:21.974455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3eb54-caf0-4cf7-be0e-0898dbf527bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:21.974762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3eb54-caf0-4cf7-be0e-0898dbf527bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:21.976165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3eb54-caf0-4cf7-be0e-0898dbf527bd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:21.987850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:21.993073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3eb54-caf0-4cf7-be0e-0898dbf527bd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:22.017697 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7aa6e3-a8b2-4a86-a163-b39a1232f2a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:22.019215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7aa6e3-a8b2-4a86-a163-b39a1232f2a7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:22.089250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3eb54-caf0-4cf7-be0e-0898dbf527bd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:22.115614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 03:03:22.121024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aa6e3-a8b2-4a86-a163-b39a1232f2a7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:22.122628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f9e2d-5e97-45f4-aae7-b080d1eb1943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:22.123490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f9e2d-5e97-45f4-aae7-b080d1eb1943 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:22.123776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f9e2d-5e97-45f4-aae7-b080d1eb1943 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:22.124056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f9e2d-5e97-45f4-aae7-b080d1eb1943 None admin] PATH_INFO: `/v3/users/5700cdd86bd44b43a6a74ec88a185c9c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:22.124181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:22.125872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f9e2d-5e97-45f4-aae7-b080d1eb1943 None admin] RBAC: Authorizing `identity:get_user(user_id=5700cdd86bd44b43a6a74ec88a185c9c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:22.127332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f9e2d-5e97-45f4-aae7-b080d1eb1943 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:22.128957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:21 2022] GET /identity/v3/users/5700cdd86bd44b43a6a74ec88a185c9c => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:22.134123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f9e2d-5e97-45f4-aae7-b080d1eb1943 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:22.147956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:22.218925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aa6e3-a8b2-4a86-a163-b39a1232f2a7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:22.228806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f9e2d-5e97-45f4-aae7-b080d1eb1943 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:22.252863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45b9bf-47fa-4401-8f00-afd4354bea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:22.253660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45b9bf-47fa-4401-8f00-afd4354bea33 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:22.253943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45b9bf-47fa-4401-8f00-afd4354bea33 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:22.254217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45b9bf-47fa-4401-8f00-afd4354bea33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:22.262141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ab187-8ec5-4d44-b3bf-e53d9cd328c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:22.262914 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ab187-8ec5-4d44-b3bf-e53d9cd328c5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:22.263194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ab187-8ec5-4d44-b3bf-e53d9cd328c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:22.263469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ab187-8ec5-4d44-b3bf-e53d9cd328c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:22.264649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ab187-8ec5-4d44-b3bf-e53d9cd328c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:22.266128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ab187-8ec5-4d44-b3bf-e53d9cd328c5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:22.267685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:22.272290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45b9bf-47fa-4401-8f00-afd4354bea33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:22.273212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ab187-8ec5-4d44-b3bf-e53d9cd328c5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:22.273788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45b9bf-47fa-4401-8f00-afd4354bea33 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ac45b9bf-47fa-4401-8f00-afd4354bea33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:03:22.294361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:22.295259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:22.296064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:03:22.296064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:03:22.296064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:03:22.296064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:22.296064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:03:22.301716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45b9bf-47fa-4401-8f00-afd4354bea33 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:22.351721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:22.357899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:22.370229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ab187-8ec5-4d44-b3bf-e53d9cd328c5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:22.400556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45b9bf-47fa-4401-8f00-afd4354bea33 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:22.404687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449158d-f285-4533-beb2-de84be5790d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:22.405328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449158d-f285-4533-beb2-de84be5790d4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:22.405652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449158d-f285-4533-beb2-de84be5790d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:22.405928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449158d-f285-4533-beb2-de84be5790d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:22.407345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449158d-f285-4533-beb2-de84be5790d4 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.domain.id=default, user.id=5700cdd86bd44b43a6a74ec88a185c9c) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:22.407654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449158d-f285-4533-beb2-de84be5790d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:22.409162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449158d-f285-4533-beb2-de84be5790d4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:22.416683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Thu May 26 03:03:22 2022] GET /identity/v3/role_assignments?user.id=5700cdd86bd44b43a6a74ec88a185c9c&scope.domain.id=default&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:22.547432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b897b-6c29-4896-99b4-fc9671db2af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:22.548116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b897b-6c29-4896-99b4-fc9671db2af3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:22.548431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b897b-6c29-4896-99b4-fc9671db2af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:22.548713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b897b-6c29-4896-99b4-fc9671db2af3 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:22.549458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b897b-6c29-4896-99b4-fc9671db2af3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:22.549765 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b897b-6c29-4896-99b4-fc9671db2af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:22.551192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b897b-6c29-4896-99b4-fc9671db2af3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:22.570513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:24.915199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3fd5-8631-4f82-b27a-3bc15b35624c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:24.915734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3fd5-8631-4f82-b27a-3bc15b35624c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:24.915734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b3fd5-8631-4f82-b27a-3bc15b35624c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:24.917164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:24.923795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b01098-de26-48a1-ad79-cb09b6e1a2cd None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:24.924340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b01098-de26-48a1-ad79-cb09b6e1a2cd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:24.924427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b01098-de26-48a1-ad79-cb09b6e1a2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:24.950009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-15b01098-de26-48a1-ad79-cb09b6e1a2cd None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:24.951218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-15b01098-de26-48a1-ad79-cb09b6e1a2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:25.050156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:25.084185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3fd5-8631-4f82-b27a-3bc15b35624c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:25.231766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec6ef-3419-433d-8143-52e2102f0e9e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.232262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b3fd5-8631-4f82-b27a-3bc15b35624c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:25.232580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec6ef-3419-433d-8143-52e2102f0e9e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.233036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec6ef-3419-433d-8143-52e2102f0e9e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.235099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:25.241269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e59253-5435-48e1-8d02-e50dd4f47f8a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.241834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e59253-5435-48e1-8d02-e50dd4f47f8a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.242289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e59253-5435-48e1-8d02-e50dd4f47f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.277340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-33e59253-5435-48e1-8d02-e50dd4f47f8a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:25.278844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-33e59253-5435-48e1-8d02-e50dd4f47f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:25.294378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef8dc8-bb76-4e19-aaed-7de66b4921cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:25.295177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef8dc8-bb76-4e19-aaed-7de66b4921cc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.295455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef8dc8-bb76-4e19-aaed-7de66b4921cc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.295725 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef8dc8-bb76-4e19-aaed-7de66b4921cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.324275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef8dc8-bb76-4e19-aaed-7de66b4921cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c7ef8dc8-bb76-4e19-aaed-7de66b4921cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:25.332545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:25.333424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:25.334187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 13/25] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:25.342487 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef8dc8-bb76-4e19-aaed-7de66b4921cc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:25.352736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:25.362305 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:25.423021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 13/26] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:25.465483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e59253-5435-48e1-8d02-e50dd4f47f8a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:25.509862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef8dc8-bb76-4e19-aaed-7de66b4921cc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:25.563553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cfa6c-9203-474d-9497-5385e81befb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:25.564531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cfa6c-9203-474d-9497-5385e81befb4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.565680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cfa6c-9203-474d-9497-5385e81befb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.566117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cfa6c-9203-474d-9497-5385e81befb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.567325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cfa6c-9203-474d-9497-5385e81befb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:25.572751 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cfa6c-9203-474d-9497-5385e81befb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:25.574366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cfa6c-9203-474d-9497-5385e81befb4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:25.587951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 14/27] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:25.589398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e9d65-33a5-4fee-9251-50028ede9eb9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.589692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e9d65-33a5-4fee-9251-50028ede9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.589975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e9d65-33a5-4fee-9251-50028ede9eb9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.591992 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 15/28] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:25.597814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef5c51-2a82-4763-9471-4bb546d436c9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.598104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef5c51-2a82-4763-9471-4bb546d436c9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.598388 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef5c51-2a82-4763-9471-4bb546d436c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.631344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e59253-5435-48e1-8d02-e50dd4f47f8a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:25.638244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8aef5c51-2a82-4763-9471-4bb546d436c9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:25.639654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8aef5c51-2a82-4763-9471-4bb546d436c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:25.668190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6057d42-dcb9-4c87-b9ea-7292a7a87962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:25.669352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6057d42-dcb9-4c87-b9ea-7292a7a87962 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.669758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6057d42-dcb9-4c87-b9ea-7292a7a87962 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.670141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6057d42-dcb9-4c87-b9ea-7292a7a87962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.681956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6057d42-dcb9-4c87-b9ea-7292a7a87962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:25.683602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6057d42-dcb9-4c87-b9ea-7292a7a87962 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c6057d42-dcb9-4c87-b9ea-7292a7a87962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:03:25.701730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:25.702702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:25.703555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:03:25.703555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:03:25.703555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:03:25.703555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:25.705511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 14/29] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:25.706665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6057d42-dcb9-4c87-b9ea-7292a7a87962 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:25.722543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:25.740496 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 16/30] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:25.742188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4729d-7bd4-4689-a2ee-7f2780bb0297 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.742486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4729d-7bd4-4689-a2ee-7f2780bb0297 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.742769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4729d-7bd4-4689-a2ee-7f2780bb0297 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.744500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 17/31] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:25.745214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4729d-7bd4-4689-a2ee-7f2780bb0297 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:25.746694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:25.839569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6057d42-dcb9-4c87-b9ea-7292a7a87962 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:25.874887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4729d-7bd4-4689-a2ee-7f2780bb0297 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:25.886076 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9265117-cfe7-4e2f-acf8-50402e9d9ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:25.887038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265117-cfe7-4e2f-acf8-50402e9d9ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.887425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265117-cfe7-4e2f-acf8-50402e9d9ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.888154 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265117-cfe7-4e2f-acf8-50402e9d9ef9 None admin] PATH_INFO: `/v3/users/5700cdd86bd44b43a6a74ec88a185c9c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.890071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9265117-cfe7-4e2f-acf8-50402e9d9ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=5700cdd86bd44b43a6a74ec88a185c9c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:25.892852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9265117-cfe7-4e2f-acf8-50402e9d9ef9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:25.895058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 15/32] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:25 2022] GET /identity/v3/users/5700cdd86bd44b43a6a74ec88a185c9c => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:25.896832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d9aa-b0e0-4a56-a515-a2b9304e07d4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.897242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d9aa-b0e0-4a56-a515-a2b9304e07d4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.897615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d9aa-b0e0-4a56-a515-a2b9304e07d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.915441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a017e-215d-4704-a8fb-7475fd974fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:25.916798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a017e-215d-4704-a8fb-7475fd974fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:25.917221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a017e-215d-4704-a8fb-7475fd974fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:25.917672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a017e-215d-4704-a8fb-7475fd974fb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:25.918441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0583d9aa-b0e0-4a56-a515-a2b9304e07d4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:25.918771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a017e-215d-4704-a8fb-7475fd974fb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:25.919314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a017e-215d-4704-a8fb-7475fd974fb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:25.919926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0583d9aa-b0e0-4a56-a515-a2b9304e07d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:25.921295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a017e-215d-4704-a8fb-7475fd974fb9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:25.941049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 18/33] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:25.946962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a017e-215d-4704-a8fb-7475fd974fb9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:26.012333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 16/34] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:26.012333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d9aa-b0e0-4a56-a515-a2b9304e07d4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:26.027228 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:26.037896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:26.089293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a017e-215d-4704-a8fb-7475fd974fb9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:26.120389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d9aa-b0e0-4a56-a515-a2b9304e07d4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:26.126213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52c7d7-6ae2-4f92-af58-6456004ea73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:26.126968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52c7d7-6ae2-4f92-af58-6456004ea73b None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:26.127320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52c7d7-6ae2-4f92-af58-6456004ea73b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:26.127666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52c7d7-6ae2-4f92-af58-6456004ea73b None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:26.128514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52c7d7-6ae2-4f92-af58-6456004ea73b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:26.130076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52c7d7-6ae2-4f92-af58-6456004ea73b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:26.159323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad2eb0-3a9b-43cf-8c42-1a1c4e97dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:26.160625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad2eb0-3a9b-43cf-8c42-1a1c4e97dc9e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:26.161139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad2eb0-3a9b-43cf-8c42-1a1c4e97dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:26.161608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad2eb0-3a9b-43cf-8c42-1a1c4e97dc9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:26.163004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad2eb0-3a9b-43cf-8c42-1a1c4e97dc9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:26.164808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad2eb0-3a9b-43cf-8c42-1a1c4e97dc9e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:26.166803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 17/35] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:26.167727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad2eb0-3a9b-43cf-8c42-1a1c4e97dc9e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:26.273905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:26.281362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad2eb0-3a9b-43cf-8c42-1a1c4e97dc9e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:26.318071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e045a6d-33a6-47c8-8c1a-337edc7b8686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:26.318740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e045a6d-33a6-47c8-8c1a-337edc7b8686 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:26.319022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e045a6d-33a6-47c8-8c1a-337edc7b8686 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:26.319303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e045a6d-33a6-47c8-8c1a-337edc7b8686 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:26.320012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e045a6d-33a6-47c8-8c1a-337edc7b8686 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:26.321530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e045a6d-33a6-47c8-8c1a-337edc7b8686 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:26.352695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 19/36] 10.222.0.15 () {60 vars in 1131 bytes} [Thu May 26 03:03:25 2022] POST /identity/v3/roles => generated 225 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:26.354047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52c7d7-6ae2-4f92-af58-6456004ea73b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:26.532239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52c7d7-6ae2-4f92-af58-6456004ea73b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:26.555336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:03:26 2022] POST /identity/v3/projects => generated 301 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:26.557839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e045a6d-33a6-47c8-8c1a-337edc7b8686 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:26.568574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:26.612901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cd287-75a7-4856-b106-4748d7d08eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:26.613598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cd287-75a7-4856-b106-4748d7d08eda None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:26.613883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cd287-75a7-4856-b106-4748d7d08eda None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:26.614160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cd287-75a7-4856-b106-4748d7d08eda None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:26.614933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cd287-75a7-4856-b106-4748d7d08eda None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:26.616577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cd287-75a7-4856-b106-4748d7d08eda None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:26.694725 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 20/38] 10.222.0.15 () {60 vars in 1131 bytes} [Thu May 26 03:03:26 2022] POST /identity/v3/roles => generated 219 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:26.721213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e045a6d-33a6-47c8-8c1a-337edc7b8686 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:26.724445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645642f5-577b-4f82-b44d-84b8bbe972fd None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:26.724737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645642f5-577b-4f82-b44d-84b8bbe972fd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:26.725999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645642f5-577b-4f82-b44d-84b8bbe972fd None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:26.727592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 21/39] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:03:26.748260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a7481-a86b-44ee-b8bf-18ff95dab3d8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:26.748795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a7481-a86b-44ee-b8bf-18ff95dab3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:26.749174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a7481-a86b-44ee-b8bf-18ff95dab3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:26.774881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3b7a7481-a86b-44ee-b8bf-18ff95dab3d8 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:26.776578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3b7a7481-a86b-44ee-b8bf-18ff95dab3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:26.786679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d2ea7-399f-40a5-a8f3-3e3aefc1e7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:26.787646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d2ea7-399f-40a5-a8f3-3e3aefc1e7c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:26.788033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d2ea7-399f-40a5-a8f3-3e3aefc1e7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:26.788438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d2ea7-399f-40a5-a8f3-3e3aefc1e7c1 None admin] PATH_INFO: `/v3/domains/default/users/5700cdd86bd44b43a6a74ec88a185c9c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:26.794448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d2ea7-399f-40a5-a8f3-3e3aefc1e7c1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5700cdd86bd44b43a6a74ec88a185c9c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:26.796252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d2ea7-399f-40a5-a8f3-3e3aefc1e7c1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:26.870706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 22/40] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:26.872071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995c2c-9c05-45de-a0cb-aaedf5ea59a3 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:26.872399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995c2c-9c05-45de-a0cb-aaedf5ea59a3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:26.872686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995c2c-9c05-45de-a0cb-aaedf5ea59a3 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:26.873972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 23/41] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:26.881401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 19/42] 10.222.0.15 () {58 vars in 1361 bytes} [Thu May 26 03:03:26 2022] PUT /identity/v3/domains/default/users/5700cdd86bd44b43a6a74ec88a185c9c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:03:26.882266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570fee6-bd9e-40f4-b4dd-0af1d6627340 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:26.882699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570fee6-bd9e-40f4-b4dd-0af1d6627340 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:26.883131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570fee6-bd9e-40f4-b4dd-0af1d6627340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:26.901582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d2ea7-399f-40a5-a8f3-3e3aefc1e7c1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:26.902105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e570fee6-bd9e-40f4-b4dd-0af1d6627340 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:26.903691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e570fee6-bd9e-40f4-b4dd-0af1d6627340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:26.920745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:27.011906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 24/43] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:27.038350 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570fee6-bd9e-40f4-b4dd-0af1d6627340 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:27.042220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d2ea7-399f-40a5-a8f3-3e3aefc1e7c1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:27.085286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:27.090417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2c536-2b20-4b0e-8b18-9793456aee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:27.091442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c536-2b20-4b0e-8b18-9793456aee2f None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:27.091759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c536-2b20-4b0e-8b18-9793456aee2f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:27.092038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c536-2b20-4b0e-8b18-9793456aee2f None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:27.093173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2c536-2b20-4b0e-8b18-9793456aee2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:27.095065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2c536-2b20-4b0e-8b18-9793456aee2f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:27.153211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570fee6-bd9e-40f4-b4dd-0af1d6627340 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:27.179879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 20/44] 10.222.0.15 () {60 vars in 1131 bytes} [Thu May 26 03:03:26 2022] POST /identity/v3/roles => generated 223 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:03:27.187012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9105cc3-2519-45c2-98cd-4ecd3f78dc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:27.187968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105cc3-2519-45c2-98cd-4ecd3f78dc09 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:27.188435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105cc3-2519-45c2-98cd-4ecd3f78dc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:27.188761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105cc3-2519-45c2-98cd-4ecd3f78dc09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:27.190600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9105cc3-2519-45c2-98cd-4ecd3f78dc09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:27.192739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9105cc3-2519-45c2-98cd-4ecd3f78dc09 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:27.195568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 25/45] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:27.201567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2c536-2b20-4b0e-8b18-9793456aee2f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:27.275975 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:27.314497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2c536-2b20-4b0e-8b18-9793456aee2f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:27.352070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f9e2a-a941-42d8-afe7-6b8250c9f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:27.352785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9e2a-a941-42d8-afe7-6b8250c9f55c None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:27.353074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9e2a-a941-42d8-afe7-6b8250c9f55c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:27.353354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9e2a-a941-42d8-afe7-6b8250c9f55c None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:27.354158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f9e2a-a941-42d8-afe7-6b8250c9f55c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:27.355634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f9e2a-a941-42d8-afe7-6b8250c9f55c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:27.436497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 21/46] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:03:27 2022] POST /identity/v3/projects => generated 312 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:29.090334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44804c71-f956-4cb6-875c-f2fa7dca7556 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.091099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44804c71-f956-4cb6-875c-f2fa7dca7556 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.091099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44804c71-f956-4cb6-875c-f2fa7dca7556 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.092568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 26/47] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:29.098460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd74e-58c8-4c63-98f1-4a3d7ea11bfe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.098866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd74e-58c8-4c63-98f1-4a3d7ea11bfe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.099115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd74e-58c8-4c63-98f1-4a3d7ea11bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.115865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-206bd74e-58c8-4c63-98f1-4a3d7ea11bfe None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:29.117391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-206bd74e-58c8-4c63-98f1-4a3d7ea11bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:29.182947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 22/48] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:29.206835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44804c71-f956-4cb6-875c-f2fa7dca7556 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:29.305190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44804c71-f956-4cb6-875c-f2fa7dca7556 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:29.307467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:29.339139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916120a4-76b3-4d2c-8da4-6c33f261f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:29.339970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916120a4-76b3-4d2c-8da4-6c33f261f1ee None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.340254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916120a4-76b3-4d2c-8da4-6c33f261f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.340857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916120a4-76b3-4d2c-8da4-6c33f261f1ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.351012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916120a4-76b3-4d2c-8da4-6c33f261f1ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-916120a4-76b3-4d2c-8da4-6c33f261f1ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:29.358759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:29.359643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:29.360424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:29.361162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 27/49] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:29.366232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd74e-58c8-4c63-98f1-4a3d7ea11bfe None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:29.413234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:29.466304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd74e-58c8-4c63-98f1-4a3d7ea11bfe None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:29.499162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91396b76-a060-43cd-bd9b-553ed1b929ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:29.499825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91396b76-a060-43cd-bd9b-553ed1b929ee None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.500660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91396b76-a060-43cd-bd9b-553ed1b929ee None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.500937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91396b76-a060-43cd-bd9b-553ed1b929ee None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.501681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91396b76-a060-43cd-bd9b-553ed1b929ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:29.501986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91396b76-a060-43cd-bd9b-553ed1b929ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:29.503369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91396b76-a060-43cd-bd9b-553ed1b929ee None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:29.514835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 23/50] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:29.521041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916120a4-76b3-4d2c-8da4-6c33f261f1ee None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:29.618617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916120a4-76b3-4d2c-8da4-6c33f261f1ee None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:29.621303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f437a7f-6a28-4acd-8cd5-31c6a9f47a02 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.621686 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f437a7f-6a28-4acd-8cd5-31c6a9f47a02 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.622034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f437a7f-6a28-4acd-8cd5-31c6a9f47a02 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.623509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 24/51] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:03:29.629365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12dfc1-0d65-479e-b69a-e962f23140e4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.629658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12dfc1-0d65-479e-b69a-e962f23140e4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.629939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12dfc1-0d65-479e-b69a-e962f23140e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.646068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ca12dfc1-0d65-479e-b69a-e962f23140e4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:29.647261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ca12dfc1-0d65-479e-b69a-e962f23140e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:29.652679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c8bc-2151-4509-ba3e-c72e09828fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:29.653546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c8bc-2151-4509-ba3e-c72e09828fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.653831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c8bc-2151-4509-ba3e-c72e09828fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.654108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c8bc-2151-4509-ba3e-c72e09828fd9 None admin] PATH_INFO: `/v3/users/5700cdd86bd44b43a6a74ec88a185c9c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.655302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17c8bc-2151-4509-ba3e-c72e09828fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=5700cdd86bd44b43a6a74ec88a185c9c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:29.656900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17c8bc-2151-4509-ba3e-c72e09828fd9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:29.658516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 28/52] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:29 2022] GET /identity/v3/users/5700cdd86bd44b43a6a74ec88a185c9c => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:29.663680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c8bc-2151-4509-ba3e-c72e09828fd9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:29.694436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:29.712998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 25/53] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:29.736795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12dfc1-0d65-479e-b69a-e962f23140e4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:29.760924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c8bc-2151-4509-ba3e-c72e09828fd9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:29.776301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:29.794112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd017fd-9775-48b9-b980-a8aeeb02ffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:29.794908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd017fd-9775-48b9-b980-a8aeeb02ffca None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.795192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd017fd-9775-48b9-b980-a8aeeb02ffca None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.795471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd017fd-9775-48b9-b980-a8aeeb02ffca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.796678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd017fd-9775-48b9-b980-a8aeeb02ffca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:29.798641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd017fd-9775-48b9-b980-a8aeeb02ffca None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:29.800669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 29/54] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:29.806102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd017fd-9775-48b9-b980-a8aeeb02ffca None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:29.837451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12dfc1-0d65-479e-b69a-e962f23140e4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:29.871155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef18557-9dc3-453c-85f2-44936dc56f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:29.871891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef18557-9dc3-453c-85f2-44936dc56f16 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.872174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef18557-9dc3-453c-85f2-44936dc56f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.872496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef18557-9dc3-453c-85f2-44936dc56f16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.873669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef18557-9dc3-453c-85f2-44936dc56f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:29.875688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef18557-9dc3-453c-85f2-44936dc56f16 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:29.877322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 26/55] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:29.882733 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef18557-9dc3-453c-85f2-44936dc56f16 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:29.901645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:29.904792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd017fd-9775-48b9-b980-a8aeeb02ffca None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:29.940362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c6c6f-af0e-4ef4-9312-e3fad3b45e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:29.941124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6c6f-af0e-4ef4-9312-e3fad3b45e8d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:29.941410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6c6f-af0e-4ef4-9312-e3fad3b45e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:29.941693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6c6f-af0e-4ef4-9312-e3fad3b45e8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:29.942578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c6c6f-af0e-4ef4-9312-e3fad3b45e8d None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.domain.id=default, user.id=5700cdd86bd44b43a6a74ec88a185c9c) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:29.942894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c6c6f-af0e-4ef4-9312-e3fad3b45e8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:29.944366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c6c6f-af0e-4ef4-9312-e3fad3b45e8d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:29.950064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 30/56] 10.222.0.15 () {56 vars in 1322 bytes} [Thu May 26 03:03:29 2022] GET /identity/v3/role_assignments?user.id=5700cdd86bd44b43a6a74ec88a185c9c&scope.domain.id=default&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:29.983742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef18557-9dc3-453c-85f2-44936dc56f16 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:29.995104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:30.021604 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a017-acc2-4209-8f81-4c9c50f411b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:30.022577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a017-acc2-4209-8f81-4c9c50f411b8 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:30.023039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a017-acc2-4209-8f81-4c9c50f411b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:30.023316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a017-acc2-4209-8f81-4c9c50f411b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:30.024403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a017-acc2-4209-8f81-4c9c50f411b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:30.026376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a017-acc2-4209-8f81-4c9c50f411b8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:30.122563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 27/57] 10.222.0.15 () {60 vars in 1140 bytes} [Thu May 26 03:03:29 2022] POST /identity/v3/projects => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:03:32.290248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812e162-ce0a-4f6d-b6b9-083198194a25 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:32.290742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812e162-ce0a-4f6d-b6b9-083198194a25 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:32.290822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812e162-ce0a-4f6d-b6b9-083198194a25 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:32.292156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 31/58] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:32.298051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f2fca-c17b-406f-88f5-4d7ef4bc5255 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:32.298438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f2fca-c17b-406f-88f5-4d7ef4bc5255 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:32.298611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f2fca-c17b-406f-88f5-4d7ef4bc5255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:32.314924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ea2f2fca-c17b-406f-88f5-4d7ef4bc5255 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:32.316096 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ea2f2fca-c17b-406f-88f5-4d7ef4bc5255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:32.379792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 28/59] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:32.402894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812e162-ce0a-4f6d-b6b9-083198194a25 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:32.499401 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812e162-ce0a-4f6d-b6b9-083198194a25 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:32.532612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe9de-9b11-4832-9b48-d620be4c3e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:32.533385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe9de-9b11-4832-9b48-d620be4c3e86 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:32.533671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe9de-9b11-4832-9b48-d620be4c3e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:32.533952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe9de-9b11-4832-9b48-d620be4c3e86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:32.535112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfe9de-9b11-4832-9b48-d620be4c3e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:32.536582 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfe9de-9b11-4832-9b48-d620be4c3e86 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:32.538141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 32/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:32.543434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f2fca-c17b-406f-88f5-4d7ef4bc5255 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:32.629169 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:32.638175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f2fca-c17b-406f-88f5-4d7ef4bc5255 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:32.670557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be081e-57c6-435f-8f05-84731975ceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:32.671206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be081e-57c6-435f-8f05-84731975ceed None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:32.671490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be081e-57c6-435f-8f05-84731975ceed None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:32.671795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be081e-57c6-435f-8f05-84731975ceed None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:32.672523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be081e-57c6-435f-8f05-84731975ceed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:32.673966 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be081e-57c6-435f-8f05-84731975ceed None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:32.765148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:03:32 2022] POST /identity/v3/users => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:36.139592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528943e8-83b7-4ab9-acdd-3ad582414245 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.141173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528943e8-83b7-4ab9-acdd-3ad582414245 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.141657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528943e8-83b7-4ab9-acdd-3ad582414245 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.143240 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 33/62] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:36.148760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e6f5-91aa-439a-8637-854e474c8d33 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.149576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e6f5-91aa-439a-8637-854e474c8d33 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.150048 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e6f5-91aa-439a-8637-854e474c8d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.171807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-86f4e6f5-91aa-439a-8637-854e474c8d33 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:36.173451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-86f4e6f5-91aa-439a-8637-854e474c8d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:36.261897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67923d-0d9a-42a1-865a-532c8699b26a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.262520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67923d-0d9a-42a1-865a-532c8699b26a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.263012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67923d-0d9a-42a1-865a-532c8699b26a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.264882 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 34/63] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:36.268303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 30/64] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:36.273838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3a952-91cb-4623-9833-77d068ae38e7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.274356 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3a952-91cb-4623-9833-77d068ae38e7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.274828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3a952-91cb-4623-9833-77d068ae38e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.297802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d7e3a952-91cb-4623-9833-77d068ae38e7 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:36.299319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d7e3a952-91cb-4623-9833-77d068ae38e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:36.326424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:36.333914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e6f5-91aa-439a-8637-854e474c8d33 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:36.401764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 35/65] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:36.403117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506bb45-51e7-4415-95d2-dd3740043fd2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.403412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506bb45-51e7-4415-95d2-dd3740043fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.403870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506bb45-51e7-4415-95d2-dd3740043fd2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.405211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 36/66] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:36.410738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a35c7-0c6d-4b0a-a214-cbc653d4ae76 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.411211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a35c7-0c6d-4b0a-a214-cbc653d4ae76 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.411630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a35c7-0c6d-4b0a-a214-cbc653d4ae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.429410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-770a35c7-0c6d-4b0a-a214-cbc653d4ae76 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:36.430807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-770a35c7-0c6d-4b0a-a214-cbc653d4ae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:36.447833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:36.471913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e6f5-91aa-439a-8637-854e474c8d33 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:36.510431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 37/67] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:36.516340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a35c7-0c6d-4b0a-a214-cbc653d4ae76 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:36.523143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde084f-1643-462d-bdda-497756170d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:36.523943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde084f-1643-462d-bdda-497756170d5e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.524228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde084f-1643-462d-bdda-497756170d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.524529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde084f-1643-462d-bdda-497756170d5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.544818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde084f-1643-462d-bdda-497756170d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-cdde084f-1643-462d-bdda-497756170d5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:36.556921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:36.557815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:36.558569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 31/68] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:03:36.559210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde084f-1643-462d-bdda-497756170d5e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:36.630082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:36.638092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a35c7-0c6d-4b0a-a214-cbc653d4ae76 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:36.663476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde084f-1643-462d-bdda-497756170d5e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:36.671157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9201b-2185-4847-b0a4-20effe9e2cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:36.672541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9201b-2185-4847-b0a4-20effe9e2cac None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.672827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9201b-2185-4847-b0a4-20effe9e2cac None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.673101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9201b-2185-4847-b0a4-20effe9e2cac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.683012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9201b-2185-4847-b0a4-20effe9e2cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-60c9201b-2185-4847-b0a4-20effe9e2cac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:36.690530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:36.691354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:36.692125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 38/69] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:36.692792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9201b-2185-4847-b0a4-20effe9e2cac None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:36.697326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeec01-56ac-4cae-b8eb-f8f439ac30e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:36.698131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeec01-56ac-4cae-b8eb-f8f439ac30e6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.698411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeec01-56ac-4cae-b8eb-f8f439ac30e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.698684 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeec01-56ac-4cae-b8eb-f8f439ac30e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.701353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:36.709039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeec01-56ac-4cae-b8eb-f8f439ac30e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1beeec01-56ac-4cae-b8eb-f8f439ac30e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:36.717292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:36.718131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:36.719509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 32/70] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:03:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:36.720266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c1ef6-fa1c-447d-9f0e-09515c9afe05 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.720564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c1ef6-fa1c-447d-9f0e-09515c9afe05 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.720839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c1ef6-fa1c-447d-9f0e-09515c9afe05 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.722082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 33/71] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:36.723139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e78540-ecf8-46ff-8e09-4a755a7c518c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.723647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e78540-ecf8-46ff-8e09-4a755a7c518c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.723901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e78540-ecf8-46ff-8e09-4a755a7c518c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.725664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 34/72] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:36.725910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e78540-ecf8-46ff-8e09-4a755a7c518c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:36.797047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9201b-2185-4847-b0a4-20effe9e2cac None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:36.833038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d4677-6f89-42de-a23d-ce7cf1d4fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:36.833711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d4677-6f89-42de-a23d-ce7cf1d4fb4f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.833904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e78540-ecf8-46ff-8e09-4a755a7c518c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:36.833998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d4677-6f89-42de-a23d-ce7cf1d4fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.834265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d4677-6f89-42de-a23d-ce7cf1d4fb4f None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.835008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d4677-6f89-42de-a23d-ce7cf1d4fb4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:36.835324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d4677-6f89-42de-a23d-ce7cf1d4fb4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:36.836754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d4677-6f89-42de-a23d-ce7cf1d4fb4f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:36.845634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 39/73] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:36.850227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d4677-6f89-42de-a23d-ce7cf1d4fb4f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:36.863637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:36.869242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870776-e44b-4046-a5e0-888e736dc4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:36.869913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870776-e44b-4046-a5e0-888e736dc4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.870195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870776-e44b-4046-a5e0-888e736dc4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.870468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870776-e44b-4046-a5e0-888e736dc4e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.875590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c870776-e44b-4046-a5e0-888e736dc4e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:36.875590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c870776-e44b-4046-a5e0-888e736dc4e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:36.875590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c870776-e44b-4046-a5e0-888e736dc4e2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:36.885378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 35/74] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:36.885378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cceac10-b383-4f91-a1fc-cd20e10f262e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.885378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cceac10-b383-4f91-a1fc-cd20e10f262e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.885378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cceac10-b383-4f91-a1fc-cd20e10f262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.898432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9cceac10-b383-4f91-a1fc-cd20e10f262e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:36.899641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9cceac10-b383-4f91-a1fc-cd20e10f262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:36.945420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d4677-6f89-42de-a23d-ce7cf1d4fb4f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:36.951543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:36.964569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 36/75] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:36.966176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc21e2-43a7-4d45-ad04-8bdbb00018d7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.966469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc21e2-43a7-4d45-ad04-8bdbb00018d7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.966747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc21e2-43a7-4d45-ad04-8bdbb00018d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.982694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7cdc21e2-43a7-4d45-ad04-8bdbb00018d7 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:36.984055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7cdc21e2-43a7-4d45-ad04-8bdbb00018d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:36.986654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aeb37-6be3-450a-b207-ad237f158a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:36.987330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aeb37-6be3-450a-b207-ad237f158a41 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:36.987615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aeb37-6be3-450a-b207-ad237f158a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:36.987974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aeb37-6be3-450a-b207-ad237f158a41 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:36.988756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972aeb37-6be3-450a-b207-ad237f158a41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:36.989066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972aeb37-6be3-450a-b207-ad237f158a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:36.990454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972aeb37-6be3-450a-b207-ad237f158a41 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:36.998385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 40/76] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:03:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:36.999165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aeb37-6be3-450a-b207-ad237f158a41 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.052540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 37/77] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:37.053206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc21e2-43a7-4d45-ad04-8bdbb00018d7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.077434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:37.099163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aeb37-6be3-450a-b207-ad237f158a41 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:37.132718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1552cd-0e59-4320-9ed9-792c1070dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:37.133591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1552cd-0e59-4320-9ed9-792c1070dae8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:37.133875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1552cd-0e59-4320-9ed9-792c1070dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:37.134154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1552cd-0e59-4320-9ed9-792c1070dae8 None admin] PATH_INFO: `/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:37.147090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1552cd-0e59-4320-9ed9-792c1070dae8 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2b7d51d6c046db8fb911ffb0bedeeb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:37.148594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1552cd-0e59-4320-9ed9-792c1070dae8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:37.150230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 41/78] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:36 2022] GET /identity/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:37.154698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1552cd-0e59-4320-9ed9-792c1070dae8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.165018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc21e2-43a7-4d45-ad04-8bdbb00018d7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:37.181927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:37.199562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5fdbe-958e-47a1-9edd-4495ad118625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:37.199977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5fdbe-958e-47a1-9edd-4495ad118625 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:37.200269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5fdbe-958e-47a1-9edd-4495ad118625 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:37.200576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5fdbe-958e-47a1-9edd-4495ad118625 None admin] PATH_INFO: `/v3/users/5700cdd86bd44b43a6a74ec88a185c9c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:37.201764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5fdbe-958e-47a1-9edd-4495ad118625 None admin] RBAC: Authorizing `identity:get_user(user_id=5700cdd86bd44b43a6a74ec88a185c9c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:37.203251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5fdbe-958e-47a1-9edd-4495ad118625 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:37.204901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 38/79] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:37 2022] GET /identity/v3/users/5700cdd86bd44b43a6a74ec88a185c9c => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:37.205665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5fdbe-958e-47a1-9edd-4495ad118625 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.256219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1552cd-0e59-4320-9ed9-792c1070dae8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:37.288088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20739a15-ab06-4bbb-a379-a2f0ef2a9b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:37.288900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20739a15-ab06-4bbb-a379-a2f0ef2a9b57 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:37.289182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20739a15-ab06-4bbb-a379-a2f0ef2a9b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:37.289454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20739a15-ab06-4bbb-a379-a2f0ef2a9b57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:37.290616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20739a15-ab06-4bbb-a379-a2f0ef2a9b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:37.292047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20739a15-ab06-4bbb-a379-a2f0ef2a9b57 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:37.293669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 42/80] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:37.294419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20739a15-ab06-4bbb-a379-a2f0ef2a9b57 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.298962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:37.303175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5fdbe-958e-47a1-9edd-4495ad118625 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:37.336229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24209a-c0a1-4317-89d7-951a0bcb90c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:37.337118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24209a-c0a1-4317-89d7-951a0bcb90c8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:37.337401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24209a-c0a1-4317-89d7-951a0bcb90c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:37.337677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24209a-c0a1-4317-89d7-951a0bcb90c8 None admin] PATH_INFO: `/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:37.338878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24209a-c0a1-4317-89d7-951a0bcb90c8 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2b7d51d6c046db8fb911ffb0bedeeb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:37.340606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24209a-c0a1-4317-89d7-951a0bcb90c8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:37.342200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 39/81] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:37 2022] GET /identity/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:37.342975 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24209a-c0a1-4317-89d7-951a0bcb90c8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.393825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20739a15-ab06-4bbb-a379-a2f0ef2a9b57 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:37.397360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:37.426603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c005-5b22-4b4c-839a-a2bad9e2ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:37.427396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c005-5b22-4b4c-839a-a2bad9e2ff4d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:37.427686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c005-5b22-4b4c-839a-a2bad9e2ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:37.427966 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c005-5b22-4b4c-839a-a2bad9e2ff4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:37.437905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664c005-5b22-4b4c-839a-a2bad9e2ff4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:37.440821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24209a-c0a1-4317-89d7-951a0bcb90c8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e664c005-5b22-4b4c-839a-a2bad9e2ff4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:37.445577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:37.446492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:37.447242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 43/82] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:37.447905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c005-5b22-4b4c-839a-a2bad9e2ff4d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.478621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152227f9-29b5-4726-9dfd-902474b172f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:37.479205 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152227f9-29b5-4726-9dfd-902474b172f4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:37.479484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152227f9-29b5-4726-9dfd-902474b172f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:37.479758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152227f9-29b5-4726-9dfd-902474b172f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:37.507002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:37.544133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c005-5b22-4b4c-839a-a2bad9e2ff4d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:37.545653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152227f9-29b5-4726-9dfd-902474b172f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:37.547744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152227f9-29b5-4726-9dfd-902474b172f4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:37.577715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa249b6-07cb-4390-a3e4-034897ec7fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:37.578352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa249b6-07cb-4390-a3e4-034897ec7fca None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:37.578641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa249b6-07cb-4390-a3e4-034897ec7fca None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:37.578930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa249b6-07cb-4390-a3e4-034897ec7fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:37.598898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:37.642992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 40/83] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:37.643641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa249b6-07cb-4390-a3e4-034897ec7fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:37.643843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152227f9-29b5-4726-9dfd-902474b172f4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.645165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa249b6-07cb-4390-a3e4-034897ec7fca None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:37.703501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:37.741197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152227f9-29b5-4726-9dfd-902474b172f4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:37.741739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 44/84] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:37.742563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa249b6-07cb-4390-a3e4-034897ec7fca None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.775801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0e2ac-3742-4d23-bfd0-6b7d596f878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:37.776495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0e2ac-3742-4d23-bfd0-6b7d596f878e None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:37.776780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0e2ac-3742-4d23-bfd0-6b7d596f878e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:37.777062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0e2ac-3742-4d23-bfd0-6b7d596f878e None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:37.777765 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0e2ac-3742-4d23-bfd0-6b7d596f878e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:37.779188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0e2ac-3742-4d23-bfd0-6b7d596f878e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:37.839079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa249b6-07cb-4390-a3e4-034897ec7fca None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:37.857699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 41/85] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:03:37 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:37.858572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0e2ac-3742-4d23-bfd0-6b7d596f878e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:37.872619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:37.884451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d65424-6f96-4799-bde4-2f28c231c5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:37.885182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65424-6f96-4799-bde4-2f28c231c5cb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:37.885464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65424-6f96-4799-bde4-2f28c231c5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:37.885745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d65424-6f96-4799-bde4-2f28c231c5cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:37.921328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:37.964751 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d65424-6f96-4799-bde4-2f28c231c5cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:37.966632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d65424-6f96-4799-bde4-2f28c231c5cb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:37.974649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0e2ac-3742-4d23-bfd0-6b7d596f878e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:38.014612 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0596bfd-af3d-458c-9a86-1baa0b2f9484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:38.016028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0596bfd-af3d-458c-9a86-1baa0b2f9484 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:38.016479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0596bfd-af3d-458c-9a86-1baa0b2f9484 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:38.016853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0596bfd-af3d-458c-9a86-1baa0b2f9484 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:38.017622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0596bfd-af3d-458c-9a86-1baa0b2f9484 None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:38.017927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0596bfd-af3d-458c-9a86-1baa0b2f9484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:38.019417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0596bfd-af3d-458c-9a86-1baa0b2f9484 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:38.028890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 42/86] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:38.029759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0596bfd-af3d-458c-9a86-1baa0b2f9484 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:38.082124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 45/87] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:38.083057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d65424-6f96-4799-bde4-2f28c231c5cb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:38.109535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:38.144190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0596bfd-af3d-458c-9a86-1baa0b2f9484 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:38.156763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:38.189993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527b285-aa91-4e9d-b494-51181a0e73f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:38.191436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527b285-aa91-4e9d-b494-51181a0e73f0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:38.191863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527b285-aa91-4e9d-b494-51181a0e73f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:38.192298 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527b285-aa91-4e9d-b494-51181a0e73f0 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:38.193670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527b285-aa91-4e9d-b494-51181a0e73f0 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:38.195125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527b285-aa91-4e9d-b494-51181a0e73f0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:38.197058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 43/88] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:38 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:38.197825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527b285-aa91-4e9d-b494-51181a0e73f0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:38.212066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d65424-6f96-4799-bde4-2f28c231c5cb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:38.254525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed29df-3ba4-4058-91b2-2112b88a4b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:38.256175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed29df-3ba4-4058-91b2-2112b88a4b97 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:38.257015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed29df-3ba4-4058-91b2-2112b88a4b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:38.257761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed29df-3ba4-4058-91b2-2112b88a4b97 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:38.259408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed29df-3ba4-4058-91b2-2112b88a4b97 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:38.261974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed29df-3ba4-4058-91b2-2112b88a4b97 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:38.264670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 46/89] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:38 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:38.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed29df-3ba4-4058-91b2-2112b88a4b97 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:38.316980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527b285-aa91-4e9d-b494-51181a0e73f0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:38.352823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24c114-198e-4639-bb4b-f2238c53f568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:38.353821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24c114-198e-4639-bb4b-f2238c53f568 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:38.354170 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24c114-198e-4639-bb4b-f2238c53f568 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:38.354557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24c114-198e-4639-bb4b-f2238c53f568 None admin] PATH_INFO: `/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:38.355847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24c114-198e-4639-bb4b-f2238c53f568 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2b7d51d6c046db8fb911ffb0bedeeb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:38.357435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24c114-198e-4639-bb4b-f2238c53f568 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:38.360146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 44/90] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:38 2022] GET /identity/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:38.361088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24c114-198e-4639-bb4b-f2238c53f568 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:38.373067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:38.390898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed29df-3ba4-4058-91b2-2112b88a4b97 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:38.423591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:38.430431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a6237-146d-4df4-9267-b8145500e8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:38.431650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a6237-146d-4df4-9267-b8145500e8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:38.432127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a6237-146d-4df4-9267-b8145500e8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:38.432605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a6237-146d-4df4-9267-b8145500e8b5 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:38.433948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a6237-146d-4df4-9267-b8145500e8b5 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:38.435702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a6237-146d-4df4-9267-b8145500e8b5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:38.437932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 47/91] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:38 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:38.439163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a6237-146d-4df4-9267-b8145500e8b5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:38.466419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24c114-198e-4639-bb4b-f2238c53f568 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:38.502623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90875017-f6a1-46ae-b7db-d1a5767bb1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:38.503287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90875017-f6a1-46ae-b7db-d1a5767bb1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:38.503575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90875017-f6a1-46ae-b7db-d1a5767bb1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:38.503857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90875017-f6a1-46ae-b7db-d1a5767bb1a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:38.504767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90875017-f6a1-46ae-b7db-d1a5767bb1a2 None admin] RBAC: Adding query filter params (role.id=64789f5937034a188d1774823d2387cb, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4, user.id=3a2b7d51d6c046db8fb911ffb0bedeeb) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:38.505084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90875017-f6a1-46ae-b7db-d1a5767bb1a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:38.506527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90875017-f6a1-46ae-b7db-d1a5767bb1a2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:38.514870 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 45/92] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:38 2022] GET /identity/v3/role_assignments?user.id=3a2b7d51d6c046db8fb911ffb0bedeeb&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=64789f5937034a188d1774823d2387cb => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:38.516281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90875017-f6a1-46ae-b7db-d1a5767bb1a2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:38.562213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a6237-146d-4df4-9267-b8145500e8b5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:38.593120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:38.624414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90875017-f6a1-46ae-b7db-d1a5767bb1a2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:38.628016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a3b9-d3cd-4cff-9a88-5a67900602eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:38.637857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a3b9-d3cd-4cff-9a88-5a67900602eb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:38.638476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a3b9-d3cd-4cff-9a88-5a67900602eb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:38.639019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a3b9-d3cd-4cff-9a88-5a67900602eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:38.640747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20a3b9-d3cd-4cff-9a88-5a67900602eb None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4, user.id=5700cdd86bd44b43a6a74ec88a185c9c) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:38.641267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20a3b9-d3cd-4cff-9a88-5a67900602eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:38.643091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20a3b9-d3cd-4cff-9a88-5a67900602eb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:38.658792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 48/93] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:38 2022] GET /identity/v3/role_assignments?user.id=5700cdd86bd44b43a6a74ec88a185c9c&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:38.660227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a3b9-d3cd-4cff-9a88-5a67900602eb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:38.662487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b85f-3db6-435e-8f37-b2772c362427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:38.663156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b85f-3db6-435e-8f37-b2772c362427 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:38.663442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b85f-3db6-435e-8f37-b2772c362427 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:38.663718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b85f-3db6-435e-8f37-b2772c362427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:38.748462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3b85f-3db6-435e-8f37-b2772c362427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:38.748462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3b85f-3db6-435e-8f37-b2772c362427 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:38.780434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:38.833198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:38.854785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a3b9-d3cd-4cff-9a88-5a67900602eb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:38.865994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 46/94] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:38.876488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b85f-3db6-435e-8f37-b2772c362427 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:38.910490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18746212-5c1c-40e5-80fd-16aa3eaff6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:38.911572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18746212-5c1c-40e5-80fd-16aa3eaff6cc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:38.912071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18746212-5c1c-40e5-80fd-16aa3eaff6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:38.912674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18746212-5c1c-40e5-80fd-16aa3eaff6cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:38.913864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18746212-5c1c-40e5-80fd-16aa3eaff6cc None admin] RBAC: Adding query filter params (role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4, user.id=3a2b7d51d6c046db8fb911ffb0bedeeb) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:38.914424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18746212-5c1c-40e5-80fd-16aa3eaff6cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:38.924755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18746212-5c1c-40e5-80fd-16aa3eaff6cc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:38.931838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 49/95] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:38 2022] GET /identity/v3/role_assignments?user.id=3a2b7d51d6c046db8fb911ffb0bedeeb&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:39.060624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b85f-3db6-435e-8f37-b2772c362427 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:39.110530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971eeb1-e348-4b4c-91c7-fd757cce3496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:39.111417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971eeb1-e348-4b4c-91c7-fd757cce3496 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:39.111711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971eeb1-e348-4b4c-91c7-fd757cce3496 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:39.111996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971eeb1-e348-4b4c-91c7-fd757cce3496 None admin] PATH_INFO: `/v3/projects/0b63af57c19e4154b0f42c8f590b42b9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:39.113268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971eeb1-e348-4b4c-91c7-fd757cce3496 None admin] RBAC: Authorizing `identity:get_project(project_id=0b63af57c19e4154b0f42c8f590b42b9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:39.114738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971eeb1-e348-4b4c-91c7-fd757cce3496 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:39.116477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 47/96] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:38 2022] GET /identity/v3/projects/0b63af57c19e4154b0f42c8f590b42b9 => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:39.122630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18746212-5c1c-40e5-80fd-16aa3eaff6cc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:39.278801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18746212-5c1c-40e5-80fd-16aa3eaff6cc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:39.320549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:39.330238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d660-d2f7-4b2a-b8e1-3b2af8a3d7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:39.331297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d660-d2f7-4b2a-b8e1-3b2af8a3d7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:39.331788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d660-d2f7-4b2a-b8e1-3b2af8a3d7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:39.332281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d660-d2f7-4b2a-b8e1-3b2af8a3d7f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:39.333421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649d660-d2f7-4b2a-b8e1-3b2af8a3d7f8 None admin] RBAC: Adding query filter params (role.id=64789f5937034a188d1774823d2387cb, scope.project.id=0b63af57c19e4154b0f42c8f590b42b9, user.id=3a2b7d51d6c046db8fb911ffb0bedeeb) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:39.333955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649d660-d2f7-4b2a-b8e1-3b2af8a3d7f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:39.335723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649d660-d2f7-4b2a-b8e1-3b2af8a3d7f8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:39.343068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 50/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:39 2022] GET /identity/v3/role_assignments?user.id=3a2b7d51d6c046db8fb911ffb0bedeeb&scope.project.id=0b63af57c19e4154b0f42c8f590b42b9&role.id=64789f5937034a188d1774823d2387cb => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:40.889501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91539e-c19c-4703-a18e-00df5776e825 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:40.890020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91539e-c19c-4703-a18e-00df5776e825 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:40.890123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91539e-c19c-4703-a18e-00df5776e825 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:40.891462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 48/98] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:40.896596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1668c-0102-4faf-b977-bc45394e01a1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:40.896989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1668c-0102-4faf-b977-bc45394e01a1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:40.897172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1668c-0102-4faf-b977-bc45394e01a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:40.922538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58e122-1832-4678-8110-7af30901dbf9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:40.922824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58e122-1832-4678-8110-7af30901dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:40.923104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58e122-1832-4678-8110-7af30901dbf9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:40.928779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 49/99] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:40.933430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364104-6d18-4bbb-8c6a-2e1487332478 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:40.933721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364104-6d18-4bbb-8c6a-2e1487332478 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:40.934002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364104-6d18-4bbb-8c6a-2e1487332478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:40.942179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-88b1668c-0102-4faf-b977-bc45394e01a1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:40.943384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-88b1668c-0102-4faf-b977-bc45394e01a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:40.969920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-52364104-6d18-4bbb-8c6a-2e1487332478 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:40.971142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-52364104-6d18-4bbb-8c6a-2e1487332478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:41.056216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:41.096030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 51/100] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:41.118865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 50/101] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:41.141897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1668c-0102-4faf-b977-bc45394e01a1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:41.161413 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52364104-6d18-4bbb-8c6a-2e1487332478 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:41.359429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1668c-0102-4faf-b977-bc45394e01a1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:41.404824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52364104-6d18-4bbb-8c6a-2e1487332478 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:41.410254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:41.445854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be5190-1d6c-484d-9447-3fe95f57886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:41.446665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be5190-1d6c-484d-9447-3fe95f57886a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:41.446952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be5190-1d6c-484d-9447-3fe95f57886a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:41.447218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be5190-1d6c-484d-9447-3fe95f57886a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:41.448554 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be5190-1d6c-484d-9447-3fe95f57886a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:41.450035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be5190-1d6c-484d-9447-3fe95f57886a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:41.455204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 52/102] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:41.465590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be5190-1d6c-484d-9447-3fe95f57886a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:41.493144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea74b38-dec6-4e78-9345-1a8f4bd51397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:41.493959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea74b38-dec6-4e78-9345-1a8f4bd51397 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:41.494240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea74b38-dec6-4e78-9345-1a8f4bd51397 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:41.494512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea74b38-dec6-4e78-9345-1a8f4bd51397 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:41.521751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea74b38-dec6-4e78-9345-1a8f4bd51397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-dea74b38-dec6-4e78-9345-1a8f4bd51397 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:41.541588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:41.542513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:41.543742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 51/103] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:41.548635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea74b38-dec6-4e78-9345-1a8f4bd51397 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:41.622599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:41.631675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be5190-1d6c-484d-9447-3fe95f57886a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:41.674550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a40dbb-4dad-4445-9170-7cb100e3bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:41.675215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a40dbb-4dad-4445-9170-7cb100e3bf9b None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:41.675498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a40dbb-4dad-4445-9170-7cb100e3bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:41.675777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a40dbb-4dad-4445-9170-7cb100e3bf9b None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:41.676513 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a40dbb-4dad-4445-9170-7cb100e3bf9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:41.677991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a40dbb-4dad-4445-9170-7cb100e3bf9b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:41.744329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea74b38-dec6-4e78-9345-1a8f4bd51397 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:41.782368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002228f2-d110-49fe-80ca-7f9bf9310065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:41.783070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002228f2-d110-49fe-80ca-7f9bf9310065 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:41.783353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002228f2-d110-49fe-80ca-7f9bf9310065 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:41.786266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002228f2-d110-49fe-80ca-7f9bf9310065 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:41.786266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002228f2-d110-49fe-80ca-7f9bf9310065 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:41.786266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002228f2-d110-49fe-80ca-7f9bf9310065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:41.786266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002228f2-d110-49fe-80ca-7f9bf9310065 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:41.797799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 52/104] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:41.798080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d50f4-2e44-4ef8-9bb3-6dd39d84f601 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:41.798636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d50f4-2e44-4ef8-9bb3-6dd39d84f601 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:41.798636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d50f4-2e44-4ef8-9bb3-6dd39d84f601 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:41.799943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 53/105] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:41.809799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d50f4-2e44-4ef8-9bb3-6dd39d84f601 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:41.809934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 53/106] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:03:41 2022] POST /identity/v3/projects => generated 302 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:41.809934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f7953-ebc8-4be8-a160-6808d73a50aa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:41.809934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f7953-ebc8-4be8-a160-6808d73a50aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:41.809934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f7953-ebc8-4be8-a160-6808d73a50aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:41.845166 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1b4f7953-ebc8-4be8-a160-6808d73a50aa None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:41.846671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1b4f7953-ebc8-4be8-a160-6808d73a50aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:41.915540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:41.923814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:41.926979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d50f4-2e44-4ef8-9bb3-6dd39d84f601 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:41.977698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6fa74-39c9-47d7-919c-f3aec3bd7527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:41.978620 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6fa74-39c9-47d7-919c-f3aec3bd7527 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:41.978906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6fa74-39c9-47d7-919c-f3aec3bd7527 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:41.979187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6fa74-39c9-47d7-919c-f3aec3bd7527 None admin] PATH_INFO: `/v3/users/344ecdfa90634d1a941d528ec8386e79` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:41.998866 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 54/107] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:42.016418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6fa74-39c9-47d7-919c-f3aec3bd7527 None admin] RBAC: Authorizing `identity:get_user(user_id=344ecdfa90634d1a941d528ec8386e79)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:42.018337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6fa74-39c9-47d7-919c-f3aec3bd7527 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:42.020813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 54/108] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:41 2022] GET /identity/v3/users/344ecdfa90634d1a941d528ec8386e79 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:42.025108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8781e2-29dd-4a37-b60a-a67e40cdd2c0 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.025405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8781e2-29dd-4a37-b60a-a67e40cdd2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.025688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8781e2-29dd-4a37-b60a-a67e40cdd2c0 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.026198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6fa74-39c9-47d7-919c-f3aec3bd7527 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:42.027203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 55/109] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:42.042008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c940-4792-4839-94d9-b4726ec07e45 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.042331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c940-4792-4839-94d9-b4726ec07e45 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.042580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c940-4792-4839-94d9-b4726ec07e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.084399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c334c940-4792-4839-94d9-b4726ec07e45 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:42.085601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c334c940-4792-4839-94d9-b4726ec07e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:42.153109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6fa74-39c9-47d7-919c-f3aec3bd7527 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:42.177358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 56/110] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:42.177964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c940-4792-4839-94d9-b4726ec07e45 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:42.191993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd646df4-d1e6-4ae6-aedb-cdd507699016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:42.192738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd646df4-d1e6-4ae6-aedb-cdd507699016 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.193026 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd646df4-d1e6-4ae6-aedb-cdd507699016 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.193304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd646df4-d1e6-4ae6-aedb-cdd507699016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.214555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:42.268823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd646df4-d1e6-4ae6-aedb-cdd507699016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:42.270303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd646df4-d1e6-4ae6-aedb-cdd507699016 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:42.304562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:42.308135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c940-4792-4839-94d9-b4726ec07e45 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:42.347020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ce51-b88a-4ee2-9334-14e72eb888c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:42.347829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ce51-b88a-4ee2-9334-14e72eb888c9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.348117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ce51-b88a-4ee2-9334-14e72eb888c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.348428 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ce51-b88a-4ee2-9334-14e72eb888c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.359773 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958ce51-b88a-4ee2-9334-14e72eb888c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:42.376154 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 55/111] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3958ce51-b88a-4ee2-9334-14e72eb888c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:42.376519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:42.377673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:42.378599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:42.379172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd646df4-d1e6-4ae6-aedb-cdd507699016 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:42.379237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 57/112] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:42.382067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ce51-b88a-4ee2-9334-14e72eb888c9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:42.434996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:42.490761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd646df4-d1e6-4ae6-aedb-cdd507699016 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:42.497097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ce51-b88a-4ee2-9334-14e72eb888c9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:42.529105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb622b-36fb-4659-aebd-ff03f563eaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:42.529932 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb622b-36fb-4659-aebd-ff03f563eaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.530219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb622b-36fb-4659-aebd-ff03f563eaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.530532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb622b-36fb-4659-aebd-ff03f563eaf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.537008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cd101-c872-4510-a136-6d395b3c8492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:42.538275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cd101-c872-4510-a136-6d395b3c8492 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.538967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cd101-c872-4510-a136-6d395b3c8492 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.539790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cd101-c872-4510-a136-6d395b3c8492 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.541221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cd101-c872-4510-a136-6d395b3c8492 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:42.542590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb622b-36fb-4659-aebd-ff03f563eaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:42.543423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cd101-c872-4510-a136-6d395b3c8492 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:42.545458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 58/113] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:42 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:42.546927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cd101-c872-4510-a136-6d395b3c8492 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-fedb622b-36fb-4659-aebd-ff03f563eaf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:42.557237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:42.558478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:42.559419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:42.561170 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 56/114] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:03:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:42.563254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17934a8-5585-4d7d-8f07-98bc6eb840a9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.563669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17934a8-5585-4d7d-8f07-98bc6eb840a9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.564074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17934a8-5585-4d7d-8f07-98bc6eb840a9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.569773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 57/115] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:42.570782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17934a8-5585-4d7d-8f07-98bc6eb840a9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:42.586421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:42.679820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cd101-c872-4510-a136-6d395b3c8492 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:42.692886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17934a8-5585-4d7d-8f07-98bc6eb840a9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:42.705266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:42.714418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d5bf9-8c7f-4368-b016-b75959b5cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:42.715360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d5bf9-8c7f-4368-b016-b75959b5cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.715700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d5bf9-8c7f-4368-b016-b75959b5cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.715982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d5bf9-8c7f-4368-b016-b75959b5cbf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.716770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d5bf9-8c7f-4368-b016-b75959b5cbf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:42.717079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d5bf9-8c7f-4368-b016-b75959b5cbf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:42.719111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d5bf9-8c7f-4368-b016-b75959b5cbf9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:42.727109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 59/116] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:42.727905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d5bf9-8c7f-4368-b016-b75959b5cbf9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:42.735862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86167891-efa3-4853-9c71-239276f192a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:42.736792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86167891-efa3-4853-9c71-239276f192a9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.737259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86167891-efa3-4853-9c71-239276f192a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.737739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86167891-efa3-4853-9c71-239276f192a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.738771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86167891-efa3-4853-9c71-239276f192a9 None admin] RBAC: Adding query filter params (role.id=c398a9e080af4ba68f03ea9f28debb38, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4, user.id=344ecdfa90634d1a941d528ec8386e79) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:42.739316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86167891-efa3-4853-9c71-239276f192a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:42.741088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86167891-efa3-4853-9c71-239276f192a9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:42.757010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 58/117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:42 2022] GET /identity/v3/role_assignments?user.id=344ecdfa90634d1a941d528ec8386e79&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=c398a9e080af4ba68f03ea9f28debb38 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:42.758998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca6a3-2bd2-4518-9499-228edb803c5d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.759648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca6a3-2bd2-4518-9499-228edb803c5d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.760113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca6a3-2bd2-4518-9499-228edb803c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.778904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-052ca6a3-2bd2-4518-9499-228edb803c5d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:42.781140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-052ca6a3-2bd2-4518-9499-228edb803c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:42.856154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:42.868240 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d5bf9-8c7f-4368-b016-b75959b5cbf9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:42.889050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 59/118] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:42.890761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cac55-525c-462a-87d5-7417d9183275 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.891234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cac55-525c-462a-87d5-7417d9183275 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.892203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cac55-525c-462a-87d5-7417d9183275 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.894087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 60/119] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:42.895130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cac55-525c-462a-87d5-7417d9183275 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:42.908001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a9951-4d9b-4577-985a-1bac5f612f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:42.908804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9951-4d9b-4577-985a-1bac5f612f63 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.909927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9951-4d9b-4577-985a-1bac5f612f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.909927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9951-4d9b-4577-985a-1bac5f612f63 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.910627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a9951-4d9b-4577-985a-1bac5f612f63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:42.911311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a9951-4d9b-4577-985a-1bac5f612f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:42.912814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a9951-4d9b-4577-985a-1bac5f612f63 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:42.923075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 60/120] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:03:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:42.928349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae357-56cd-4468-bb5c-9e4e95934119 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:42.928349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae357-56cd-4468-bb5c-9e4e95934119 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:42.928349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae357-56cd-4468-bb5c-9e4e95934119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:42.945598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7eeae357-56cd-4468-bb5c-9e4e95934119 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:42.946893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7eeae357-56cd-4468-bb5c-9e4e95934119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:43.032976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cac55-525c-462a-87d5-7417d9183275 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.037821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 61/121] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:43.038917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeae357-56cd-4468-bb5c-9e4e95934119 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.043193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:43.077897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e8d63-a23b-496b-b0b4-188dd784fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.079013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e8d63-a23b-496b-b0b4-188dd784fe2c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.080092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e8d63-a23b-496b-b0b4-188dd784fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.080448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e8d63-a23b-496b-b0b4-188dd784fe2c None admin] PATH_INFO: `/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.081684 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e8d63-a23b-496b-b0b4-188dd784fe2c None admin] RBAC: Authorizing `identity:get_user(user_id=3a2b7d51d6c046db8fb911ffb0bedeeb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:43.083262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e8d63-a23b-496b-b0b4-188dd784fe2c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:43.085432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 61/122] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:42 2022] GET /identity/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:43.086274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e8d63-a23b-496b-b0b4-188dd784fe2c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.151755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:43.164982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeae357-56cd-4468-bb5c-9e4e95934119 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.201836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1be88-c839-4b95-93c7-2fc282acb7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.203240 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1be88-c839-4b95-93c7-2fc282acb7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.203632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1be88-c839-4b95-93c7-2fc282acb7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.204037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1be88-c839-4b95-93c7-2fc282acb7f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.204968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e8d63-a23b-496b-b0b4-188dd784fe2c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.214684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1be88-c839-4b95-93c7-2fc282acb7f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e5a1be88-c839-4b95-93c7-2fc282acb7f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:43.223943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:43.224808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:43.225563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 62/123] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:43.226918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1be88-c839-4b95-93c7-2fc282acb7f4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.245374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2fafc-e245-4b65-b656-c20e41339d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.246530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2fafc-e245-4b65-b656-c20e41339d47 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.246816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2fafc-e245-4b65-b656-c20e41339d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.247099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2fafc-e245-4b65-b656-c20e41339d47 None admin] PATH_INFO: `/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.249093 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2fafc-e245-4b65-b656-c20e41339d47 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2b7d51d6c046db8fb911ffb0bedeeb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:43.250836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2fafc-e245-4b65-b656-c20e41339d47 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:43.253405 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 62/124] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:43 2022] GET /identity/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:43.254019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2fafc-e245-4b65-b656-c20e41339d47 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.305386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:43.364890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1be88-c839-4b95-93c7-2fc282acb7f4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.371526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2fafc-e245-4b65-b656-c20e41339d47 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.405358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a13699-06a5-415a-a62e-914dbf647b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.406819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a13699-06a5-415a-a62e-914dbf647b45 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.407187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a13699-06a5-415a-a62e-914dbf647b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.407647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a13699-06a5-415a-a62e-914dbf647b45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.417881 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9c685-5852-4cea-aa93-1f6ee796ac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.419218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c685-5852-4cea-aa93-1f6ee796ac64 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.419332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a13699-06a5-415a-a62e-914dbf647b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:43.419737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c685-5852-4cea-aa93-1f6ee796ac64 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.420153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c685-5852-4cea-aa93-1f6ee796ac64 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.421547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9c685-5852-4cea-aa93-1f6ee796ac64 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:43.423253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9c685-5852-4cea-aa93-1f6ee796ac64 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:43.425130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 63/125] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:43 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:43.426142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9c685-5852-4cea-aa93-1f6ee796ac64 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-85a13699-06a5-415a-a62e-914dbf647b45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:43.432288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:43.433376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:43.434346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:43.435789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 63/126] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:43.436528 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a13699-06a5-415a-a62e-914dbf647b45 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.440702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:43.545788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a13699-06a5-415a-a62e-914dbf647b45 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.554863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9c685-5852-4cea-aa93-1f6ee796ac64 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.564858 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:43.581576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8b210-2a21-4050-814c-a4a6444a5370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.582534 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8b210-2a21-4050-814c-a4a6444a5370 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.584394 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8b210-2a21-4050-814c-a4a6444a5370 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.584394 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8b210-2a21-4050-814c-a4a6444a5370 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.584583 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8b210-2a21-4050-814c-a4a6444a5370 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:43.586115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8b210-2a21-4050-814c-a4a6444a5370 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:43.588367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 64/127] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:43 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:43.589402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8b210-2a21-4050-814c-a4a6444a5370 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.591225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f2e05-b94c-43c0-9f7f-9a19d8b99a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.591904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f2e05-b94c-43c0-9f7f-9a19d8b99a3d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.592303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f2e05-b94c-43c0-9f7f-9a19d8b99a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.592615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f2e05-b94c-43c0-9f7f-9a19d8b99a3d None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.593598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f2e05-b94c-43c0-9f7f-9a19d8b99a3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:43.593916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f2e05-b94c-43c0-9f7f-9a19d8b99a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:43.595354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f2e05-b94c-43c0-9f7f-9a19d8b99a3d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:43.605123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 64/128] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:43.606021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f2e05-b94c-43c0-9f7f-9a19d8b99a3d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.666846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:43.697753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8b210-2a21-4050-814c-a4a6444a5370 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.711171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f2e05-b94c-43c0-9f7f-9a19d8b99a3d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.733664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d63ec9-12cb-4647-9c17-655971c6b94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.734560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63ec9-12cb-4647-9c17-655971c6b94b None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.734846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63ec9-12cb-4647-9c17-655971c6b94b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.735177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63ec9-12cb-4647-9c17-655971c6b94b None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/users/3a2b7d51d6c046db8fb911ffb0bedeeb/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.737208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d63ec9-12cb-4647-9c17-655971c6b94b None admin] RBAC: Authorizing `identity:create_grant(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4, user_id=3a2b7d51d6c046db8fb911ffb0bedeeb, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:43.738687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d63ec9-12cb-4647-9c17-655971c6b94b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:43.747054 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ef996-2e04-4438-bfd4-497522f1e534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.747725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ef996-2e04-4438-bfd4-497522f1e534 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.748012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ef996-2e04-4438-bfd4-497522f1e534 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.748293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ef996-2e04-4438-bfd4-497522f1e534 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.749058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ef996-2e04-4438-bfd4-497522f1e534 None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:43.749905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ef996-2e04-4438-bfd4-497522f1e534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:43.751331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ef996-2e04-4438-bfd4-497522f1e534 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:43.759510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 65/129] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:43.761148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ef996-2e04-4438-bfd4-497522f1e534 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.826938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:43.855010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 65/130] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:03:43 2022] PUT /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/users/3a2b7d51d6c046db8fb911ffb0bedeeb/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:03:43.861821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d63ec9-12cb-4647-9c17-655971c6b94b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:43.900225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ef996-2e04-4438-bfd4-497522f1e534 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:43.981202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff990b-84a5-42e8-ba5d-0d987930214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:43.982441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff990b-84a5-42e8-ba5d-0d987930214d None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:43.982731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff990b-84a5-42e8-ba5d-0d987930214d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:43.983013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff990b-84a5-42e8-ba5d-0d987930214d None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/users/3a2b7d51d6c046db8fb911ffb0bedeeb/roles/90baedc1773f4d67ae7e85fa74a93b5d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:43.986369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff990b-84a5-42e8-ba5d-0d987930214d None admin] RBAC: Authorizing `identity:create_grant(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4, user_id=3a2b7d51d6c046db8fb911ffb0bedeeb, role_id=90baedc1773f4d67ae7e85fa74a93b5d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:43.988027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff990b-84a5-42e8-ba5d-0d987930214d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:44.053232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d63ec9-12cb-4647-9c17-655971c6b94b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:44.087921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 66/131] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:03:43 2022] PUT /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/users/3a2b7d51d6c046db8fb911ffb0bedeeb/roles/90baedc1773f4d67ae7e85fa74a93b5d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:03:44.088563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:44.088968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff990b-84a5-42e8-ba5d-0d987930214d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:44.095703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806c340-61f6-42a9-b2cb-bec9c4b7c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:44.099223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806c340-61f6-42a9-b2cb-bec9c4b7c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:44.099223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806c340-61f6-42a9-b2cb-bec9c4b7c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:44.099223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806c340-61f6-42a9-b2cb-bec9c4b7c9d7 None admin] PATH_INFO: `/v3/users/5700cdd86bd44b43a6a74ec88a185c9c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:44.099223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806c340-61f6-42a9-b2cb-bec9c4b7c9d7 None admin] RBAC: Authorizing `identity:get_user(user_id=5700cdd86bd44b43a6a74ec88a185c9c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:44.100456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806c340-61f6-42a9-b2cb-bec9c4b7c9d7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:44.102257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 66/132] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:43 2022] GET /identity/v3/users/5700cdd86bd44b43a6a74ec88a185c9c => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:44.108252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806c340-61f6-42a9-b2cb-bec9c4b7c9d7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:44.267546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:44.294622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff990b-84a5-42e8-ba5d-0d987930214d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:44.317520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806c340-61f6-42a9-b2cb-bec9c4b7c9d7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:44.381732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf226-19b6-4dc2-99bc-ae9806548d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:44.382077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc632cae-90b4-4548-949e-c24502f863c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:44.382541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf226-19b6-4dc2-99bc-ae9806548d6b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:44.382831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf226-19b6-4dc2-99bc-ae9806548d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:44.382936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc632cae-90b4-4548-949e-c24502f863c5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:44.383108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf226-19b6-4dc2-99bc-ae9806548d6b None admin] PATH_INFO: `/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:44.383215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc632cae-90b4-4548-949e-c24502f863c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:44.383454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc632cae-90b4-4548-949e-c24502f863c5 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:44.384912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc632cae-90b4-4548-949e-c24502f863c5 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:44.385291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf226-19b6-4dc2-99bc-ae9806548d6b None admin] RBAC: Authorizing `identity:get_user(user_id=3a2b7d51d6c046db8fb911ffb0bedeeb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:44.386398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc632cae-90b4-4548-949e-c24502f863c5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:44.387209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf226-19b6-4dc2-99bc-ae9806548d6b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:44.388069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 67/133] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:44 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:44.389571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 67/134] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:44 2022] GET /identity/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:44.393668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc632cae-90b4-4548-949e-c24502f863c5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:44.394867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf226-19b6-4dc2-99bc-ae9806548d6b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:44.533879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:44.570942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc632cae-90b4-4548-949e-c24502f863c5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:44.609054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8f94d-c84d-4de8-9159-09ac5917b474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:44.610410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8f94d-c84d-4de8-9159-09ac5917b474 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:44.610899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8f94d-c84d-4de8-9159-09ac5917b474 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:44.611377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8f94d-c84d-4de8-9159-09ac5917b474 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/users/5700cdd86bd44b43a6a74ec88a185c9c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:44.613699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8f94d-c84d-4de8-9159-09ac5917b474 None admin] RBAC: Authorizing `identity:create_grant(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4, user_id=5700cdd86bd44b43a6a74ec88a185c9c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:44.615473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8f94d-c84d-4de8-9159-09ac5917b474 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:44.623336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf226-19b6-4dc2-99bc-ae9806548d6b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:44.661012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329c7a8-f478-4f29-b10f-77546b69ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:44.662261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329c7a8-f478-4f29-b10f-77546b69ca17 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:44.662794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329c7a8-f478-4f29-b10f-77546b69ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:44.663274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329c7a8-f478-4f29-b10f-77546b69ca17 None admin] PATH_INFO: `/v3/projects/0b63af57c19e4154b0f42c8f590b42b9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:44.664766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329c7a8-f478-4f29-b10f-77546b69ca17 None admin] RBAC: Authorizing `identity:get_project(project_id=0b63af57c19e4154b0f42c8f590b42b9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:44.666400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329c7a8-f478-4f29-b10f-77546b69ca17 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:44.668290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 68/135] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:44 2022] GET /identity/v3/projects/0b63af57c19e4154b0f42c8f590b42b9 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:44.669935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a031680-3a96-4c15-85cb-de81c014c688 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:44.670432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a031680-3a96-4c15-85cb-de81c014c688 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:44.670930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a031680-3a96-4c15-85cb-de81c014c688 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:44.672532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 69/136] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:44.680373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e6093-d250-4f8e-89a7-cca2d85c19fb None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:44.680373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e6093-d250-4f8e-89a7-cca2d85c19fb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:44.680373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e6093-d250-4f8e-89a7-cca2d85c19fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:44.696725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-161e6093-d250-4f8e-89a7-cca2d85c19fb None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:44.697918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-161e6093-d250-4f8e-89a7-cca2d85c19fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:44.707342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 68/137] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:03:44 2022] PUT /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/users/5700cdd86bd44b43a6a74ec88a185c9c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:03:44.708561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8f94d-c84d-4de8-9159-09ac5917b474 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:44.729108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:44.834001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 70/138] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:44.886783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e6093-d250-4f8e-89a7-cca2d85c19fb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:44.937657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8f94d-c84d-4de8-9159-09ac5917b474 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:44.980931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:44.989490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5975f-5f0f-4a87-b33a-231491e424ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:44.991245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5975f-5f0f-4a87-b33a-231491e424ae None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:44.991639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5975f-5f0f-4a87-b33a-231491e424ae None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:44.992027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5975f-5f0f-4a87-b33a-231491e424ae None admin] PATH_INFO: `/v3/projects/0b63af57c19e4154b0f42c8f590b42b9/users/3a2b7d51d6c046db8fb911ffb0bedeeb/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:44.994322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5975f-5f0f-4a87-b33a-231491e424ae None admin] RBAC: Authorizing `identity:create_grant(project_id=0b63af57c19e4154b0f42c8f590b42b9, user_id=3a2b7d51d6c046db8fb911ffb0bedeeb, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:44.995973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5975f-5f0f-4a87-b33a-231491e424ae None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:45.102823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e6093-d250-4f8e-89a7-cca2d85c19fb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:45.107647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 69/139] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:03:44 2022] PUT /identity/v3/projects/0b63af57c19e4154b0f42c8f590b42b9/users/3a2b7d51d6c046db8fb911ffb0bedeeb/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:03:45.160750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab376b6-2065-430f-9ef7-2aaacb869506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:45.161569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab376b6-2065-430f-9ef7-2aaacb869506 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:45.161853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab376b6-2065-430f-9ef7-2aaacb869506 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:45.162129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab376b6-2065-430f-9ef7-2aaacb869506 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:45.169278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab376b6-2065-430f-9ef7-2aaacb869506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:45.170769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab376b6-2065-430f-9ef7-2aaacb869506 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:45.172589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 71/140] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:45.178512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5975f-5f0f-4a87-b33a-231491e424ae None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:45.245065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94f917-bb33-40a7-869a-22bcf9462491 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:45.245358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94f917-bb33-40a7-869a-22bcf9462491 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:45.245634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94f917-bb33-40a7-869a-22bcf9462491 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:45.247015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 72/141] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:45.253005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e08de7-a665-497d-a84a-51a5d4f859fd None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:45.253291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e08de7-a665-497d-a84a-51a5d4f859fd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:45.253572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e08de7-a665-497d-a84a-51a5d4f859fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:45.273027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-77e08de7-a665-497d-a84a-51a5d4f859fd None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:45.274352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-77e08de7-a665-497d-a84a-51a5d4f859fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:45.313063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:45.401264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5975f-5f0f-4a87-b33a-231491e424ae None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:45.414032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 73/142] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:45.450292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91a458-d8f8-46ac-bbc6-6caad4ccef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:45.450979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91a458-d8f8-46ac-bbc6-6caad4ccef16 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:45.451268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91a458-d8f8-46ac-bbc6-6caad4ccef16 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:45.451549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91a458-d8f8-46ac-bbc6-6caad4ccef16 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:45.452325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91a458-d8f8-46ac-bbc6-6caad4ccef16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:45.453864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91a458-d8f8-46ac-bbc6-6caad4ccef16 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:45.484441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e08de7-a665-497d-a84a-51a5d4f859fd None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:45.580916 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 70/143] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:03:45 2022] POST /identity/v3/users => generated 283 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:45.627756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e08de7-a665-497d-a84a-51a5d4f859fd None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:45.676064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180a68b-ad20-4c64-9d5f-d412396f4497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:45.676924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180a68b-ad20-4c64-9d5f-d412396f4497 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:45.677207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180a68b-ad20-4c64-9d5f-d412396f4497 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:45.677478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180a68b-ad20-4c64-9d5f-d412396f4497 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:45.689452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180a68b-ad20-4c64-9d5f-d412396f4497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-0180a68b-ad20-4c64-9d5f-d412396f4497 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:45.701645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:45.702666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:45.703479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 74/144] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:03:45.713486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91a458-d8f8-46ac-bbc6-6caad4ccef16 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:45.801201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:45.880045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91a458-d8f8-46ac-bbc6-6caad4ccef16 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:45.915402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f58fd-62ce-47c6-b08c-58964920ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:45.916081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f58fd-62ce-47c6-b08c-58964920ebfa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:45.916389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f58fd-62ce-47c6-b08c-58964920ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:45.916667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f58fd-62ce-47c6-b08c-58964920ebfa None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:45.917431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f58fd-62ce-47c6-b08c-58964920ebfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:45.917737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f58fd-62ce-47c6-b08c-58964920ebfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:45.919140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f58fd-62ce-47c6-b08c-58964920ebfa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:45.928406 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 71/145] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:45.933577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180a68b-ad20-4c64-9d5f-d412396f4497 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:45.960113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:46.061372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180a68b-ad20-4c64-9d5f-d412396f4497 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:46.105510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86128a7-1707-4a4d-8ad2-3775fdd204d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:46.106444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86128a7-1707-4a4d-8ad2-3775fdd204d8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:46.106733 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86128a7-1707-4a4d-8ad2-3775fdd204d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:46.107013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86128a7-1707-4a4d-8ad2-3775fdd204d8 None admin] PATH_INFO: `/v3/users/344ecdfa90634d1a941d528ec8386e79` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:46.108265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86128a7-1707-4a4d-8ad2-3775fdd204d8 None admin] RBAC: Authorizing `identity:get_user(user_id=344ecdfa90634d1a941d528ec8386e79)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:46.109845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86128a7-1707-4a4d-8ad2-3775fdd204d8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:46.111755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 75/146] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:45 2022] GET /identity/v3/users/344ecdfa90634d1a941d528ec8386e79 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:46.117263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f58fd-62ce-47c6-b08c-58964920ebfa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:46.230390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f58fd-62ce-47c6-b08c-58964920ebfa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:46.234344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:46.273399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee04841-e228-43d3-ba24-dfc059e84192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:46.274352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee04841-e228-43d3-ba24-dfc059e84192 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:46.274636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee04841-e228-43d3-ba24-dfc059e84192 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:46.274912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee04841-e228-43d3-ba24-dfc059e84192 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:46.276112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee04841-e228-43d3-ba24-dfc059e84192 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:46.277599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee04841-e228-43d3-ba24-dfc059e84192 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:46.279278 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 72/147] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:46 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:46.285446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86128a7-1707-4a4d-8ad2-3775fdd204d8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:46.380261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:46.401930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86128a7-1707-4a4d-8ad2-3775fdd204d8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:46.440187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752cce6-743c-4d4a-aa70-395d8af940d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:46.441117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752cce6-743c-4d4a-aa70-395d8af940d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:46.441401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752cce6-743c-4d4a-aa70-395d8af940d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:46.441675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752cce6-743c-4d4a-aa70-395d8af940d2 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/users/344ecdfa90634d1a941d528ec8386e79/roles/c398a9e080af4ba68f03ea9f28debb38` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:46.443671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752cce6-743c-4d4a-aa70-395d8af940d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4, user_id=344ecdfa90634d1a941d528ec8386e79, role_id=c398a9e080af4ba68f03ea9f28debb38)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:46.445171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752cce6-743c-4d4a-aa70-395d8af940d2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:46.515592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 76/148] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:03:46 2022] PUT /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/users/344ecdfa90634d1a941d528ec8386e79/roles/c398a9e080af4ba68f03ea9f28debb38 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:03:46.963571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfb3da-7762-434c-a239-88d3e4a4b76c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:46.963947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfb3da-7762-434c-a239-88d3e4a4b76c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:46.964137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfb3da-7762-434c-a239-88d3e4a4b76c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:46.965865 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 73/149] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:46.971538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fc2a9-05b0-4971-a6b6-c229fb512e86 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:46.971834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fc2a9-05b0-4971-a6b6-c229fb512e86 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:46.972111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fc2a9-05b0-4971-a6b6-c229fb512e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:46.993997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-967fc2a9-05b0-4971-a6b6-c229fb512e86 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:46.995178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-967fc2a9-05b0-4971-a6b6-c229fb512e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:47.078146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 77/150] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:47.113834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfb3da-7762-434c-a239-88d3e4a4b76c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:47.241771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfb3da-7762-434c-a239-88d3e4a4b76c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:47.287921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fc00f-ae4c-4a03-95b9-079175fd4efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:47.288815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc00f-ae4c-4a03-95b9-079175fd4efe None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:47.289159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc00f-ae4c-4a03-95b9-079175fd4efe None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:47.289437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc00f-ae4c-4a03-95b9-079175fd4efe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:47.302607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fc00f-ae4c-4a03-95b9-079175fd4efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bd4fc00f-ae4c-4a03-95b9-079175fd4efe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:47.310605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:47.311483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:47.312254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 74/151] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:47.317823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fc2a9-05b0-4971-a6b6-c229fb512e86 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:47.426202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:47.455173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fc2a9-05b0-4971-a6b6-c229fb512e86 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:47.496153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fb371-b879-49e6-8afb-208ff86fcb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:47.496856 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fb371-b879-49e6-8afb-208ff86fcb94 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:47.497140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fb371-b879-49e6-8afb-208ff86fcb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:47.497417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fb371-b879-49e6-8afb-208ff86fcb94 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:47.498161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fb371-b879-49e6-8afb-208ff86fcb94 None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:47.498463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fb371-b879-49e6-8afb-208ff86fcb94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:47.499865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fb371-b879-49e6-8afb-208ff86fcb94 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:47.512063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 78/152] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:47.518221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fc00f-ae4c-4a03-95b9-079175fd4efe None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:47.572668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:47.664183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fc00f-ae4c-4a03-95b9-079175fd4efe None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:47.710471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8cf84-28bd-481f-b659-fe687d1283fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:47.711266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8cf84-28bd-481f-b659-fe687d1283fb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:47.711545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8cf84-28bd-481f-b659-fe687d1283fb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:47.711818 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8cf84-28bd-481f-b659-fe687d1283fb None admin] PATH_INFO: `/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:47.713064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8cf84-28bd-481f-b659-fe687d1283fb None admin] RBAC: Authorizing `identity:get_user(user_id=3a2b7d51d6c046db8fb911ffb0bedeeb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:47.714524 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8cf84-28bd-481f-b659-fe687d1283fb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:47.716742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 75/153] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:47 2022] GET /identity/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:47.722623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fb371-b879-49e6-8afb-208ff86fcb94 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:47.858236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fb371-b879-49e6-8afb-208ff86fcb94 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:47.894059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6753b-9c24-407f-a71f-e5b21524d66a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:47.894382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6753b-9c24-407f-a71f-e5b21524d66a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:47.894657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6753b-9c24-407f-a71f-e5b21524d66a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:47.896281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 76/154] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:47.897496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276993b4-dc83-4e11-a3c9-f273896420f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:47.898149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276993b4-dc83-4e11-a3c9-f273896420f7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:47.898428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276993b4-dc83-4e11-a3c9-f273896420f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:47.898701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276993b4-dc83-4e11-a3c9-f273896420f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:47.901427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9211dd-1b35-4c6e-9231-aa11aabb5a39 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:47.901715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9211dd-1b35-4c6e-9231-aa11aabb5a39 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:47.901997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9211dd-1b35-4c6e-9231-aa11aabb5a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:47.903949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:47.944237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3e9211dd-1b35-4c6e-9231-aa11aabb5a39 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:47.945465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3e9211dd-1b35-4c6e-9231-aa11aabb5a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:48.040140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276993b4-dc83-4e11-a3c9-f273896420f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:48.041667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276993b4-dc83-4e11-a3c9-f273896420f7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:48.106067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 77/155] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:48.154298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9211dd-1b35-4c6e-9231-aa11aabb5a39 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:48.223492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 79/156] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:48.228663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:48.230260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276993b4-dc83-4e11-a3c9-f273896420f7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:48.298135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:48.380044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9211dd-1b35-4c6e-9231-aa11aabb5a39 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:48.410633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276993b4-dc83-4e11-a3c9-f273896420f7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:48.475961 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147bec0-c2b7-46d4-914a-0d26b22bac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:48.477214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147bec0-c2b7-46d4-914a-0d26b22bac75 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:48.477731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147bec0-c2b7-46d4-914a-0d26b22bac75 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:48.478211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147bec0-c2b7-46d4-914a-0d26b22bac75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:48.500296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147bec0-c2b7-46d4-914a-0d26b22bac75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:48.501011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82255ad5-754f-4458-a315-35e3d7a3091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:48.501889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82255ad5-754f-4458-a315-35e3d7a3091b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:48.502166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82255ad5-754f-4458-a315-35e3d7a3091b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:48.502436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82255ad5-754f-4458-a315-35e3d7a3091b None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:48.503671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82255ad5-754f-4458-a315-35e3d7a3091b None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:48.505129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82255ad5-754f-4458-a315-35e3d7a3091b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:48.511437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 80/157] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:48 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f147bec0-c2b7-46d4-914a-0d26b22bac75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:48.515341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:48.516214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:48.517016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:48.523801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 78/158] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:03:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:03:48.525305 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147bec0-c2b7-46d4-914a-0d26b22bac75 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:48.525413 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82255ad5-754f-4458-a315-35e3d7a3091b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:48.707194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:48.720899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82255ad5-754f-4458-a315-35e3d7a3091b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:48.725335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:48.729161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147bec0-c2b7-46d4-914a-0d26b22bac75 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:48.789687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5236d17-dfe8-41c1-b033-5687d668b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:48.790369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5236d17-dfe8-41c1-b033-5687d668b020 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:48.790652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5236d17-dfe8-41c1-b033-5687d668b020 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:48.790925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5236d17-dfe8-41c1-b033-5687d668b020 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:48.791790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5236d17-dfe8-41c1-b033-5687d668b020 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:48.792097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5236d17-dfe8-41c1-b033-5687d668b020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:48.793610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5236d17-dfe8-41c1-b033-5687d668b020 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:48.817513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 81/159] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:03:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:48.818283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8f7e5-b4cf-4b01-8c9a-ca4b7249c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:48.823139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8f7e5-b4cf-4b01-8c9a-ca4b7249c005 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:48.823139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8f7e5-b4cf-4b01-8c9a-ca4b7249c005 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:48.823139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8f7e5-b4cf-4b01-8c9a-ca4b7249c005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:48.823139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8f7e5-b4cf-4b01-8c9a-ca4b7249c005 None admin] RBAC: Adding query filter params (role.id=64789f5937034a188d1774823d2387cb, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4, user.id=3a2b7d51d6c046db8fb911ffb0bedeeb) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:48.823139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8f7e5-b4cf-4b01-8c9a-ca4b7249c005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:48.823139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8f7e5-b4cf-4b01-8c9a-ca4b7249c005 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:48.824216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5236d17-dfe8-41c1-b033-5687d668b020 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:48.833221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 79/160] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:48 2022] GET /identity/v3/role_assignments?user.id=3a2b7d51d6c046db8fb911ffb0bedeeb&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=64789f5937034a188d1774823d2387cb => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:48.845258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcd76c-bec2-414e-b489-d44a7d83b3a8 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:48.848931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcd76c-bec2-414e-b489-d44a7d83b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:48.848931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcd76c-bec2-414e-b489-d44a7d83b3a8 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:48.848931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 80/161] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:48.863644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8c9f-67dd-48e8-b14e-2fb7bff190c1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:48.864213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8c9f-67dd-48e8-b14e-2fb7bff190c1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:48.864700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8c9f-67dd-48e8-b14e-2fb7bff190c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:48.894131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-04bf8c9f-67dd-48e8-b14e-2fb7bff190c1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:48.895664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-04bf8c9f-67dd-48e8-b14e-2fb7bff190c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:49.029133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5236d17-dfe8-41c1-b033-5687d668b020 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:49.094551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 81/162] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:49.107798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a351b9-423e-48e9-a718-6ded5210ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:49.108748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a351b9-423e-48e9-a718-6ded5210ea0e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:49.109031 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a351b9-423e-48e9-a718-6ded5210ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:49.109342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a351b9-423e-48e9-a718-6ded5210ea0e None admin] PATH_INFO: `/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:49.113038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a351b9-423e-48e9-a718-6ded5210ea0e None admin] RBAC: Authorizing `identity:get_user(user_id=3a2b7d51d6c046db8fb911ffb0bedeeb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:49.114503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a351b9-423e-48e9-a718-6ded5210ea0e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:49.116188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 82/163] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:48 2022] GET /identity/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:49.121917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf8c9f-67dd-48e8-b14e-2fb7bff190c1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:49.141040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a351b9-423e-48e9-a718-6ded5210ea0e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:49.202773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:49.304079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:49.322900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a351b9-423e-48e9-a718-6ded5210ea0e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:49.331601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf8c9f-67dd-48e8-b14e-2fb7bff190c1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:49.368693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e06d-3689-47b9-8054-a82797be95d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:49.369517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e06d-3689-47b9-8054-a82797be95d6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:49.369801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e06d-3689-47b9-8054-a82797be95d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:49.370079 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e06d-3689-47b9-8054-a82797be95d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:49.393769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7e06d-3689-47b9-8054-a82797be95d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:49.401807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4281a7-46f2-4516-9ba2-a168e7ccd230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:49.402469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4281a7-46f2-4516-9ba2-a168e7ccd230 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:49.402751 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4281a7-46f2-4516-9ba2-a168e7ccd230 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:49.403025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4281a7-46f2-4516-9ba2-a168e7ccd230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-89d7e06d-3689-47b9-8054-a82797be95d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:49.407094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:49.408032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:49.409350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 83/164] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:49.419468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e06d-3689-47b9-8054-a82797be95d6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:49.572771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:49.574951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e06d-3689-47b9-8054-a82797be95d6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:49.597432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4281a7-46f2-4516-9ba2-a168e7ccd230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:49.598946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4281a7-46f2-4516-9ba2-a168e7ccd230 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:49.621589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfebf8-13c8-4c2f-810f-65ef8fbb3fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:49.622282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfebf8-13c8-4c2f-810f-65ef8fbb3fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:49.622575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfebf8-13c8-4c2f-810f-65ef8fbb3fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:49.622844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfebf8-13c8-4c2f-810f-65ef8fbb3fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:49.623599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfebf8-13c8-4c2f-810f-65ef8fbb3fb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:49.624469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfebf8-13c8-4c2f-810f-65ef8fbb3fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:49.625883 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfebf8-13c8-4c2f-810f-65ef8fbb3fb6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:49.639162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 84/165] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:49.645477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfebf8-13c8-4c2f-810f-65ef8fbb3fb6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:49.780959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfebf8-13c8-4c2f-810f-65ef8fbb3fb6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:49.833934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:49.834619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 82/166] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:49.835126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41519-c5e7-4107-aa3e-3e735e2c24e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:49.835672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55affb9-7052-4bc7-be66-f3533d5e2165 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:49.835960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55affb9-7052-4bc7-be66-f3533d5e2165 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:49.836062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41519-c5e7-4107-aa3e-3e735e2c24e7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:49.836241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55affb9-7052-4bc7-be66-f3533d5e2165 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:49.836368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41519-c5e7-4107-aa3e-3e735e2c24e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:49.836575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41519-c5e7-4107-aa3e-3e735e2c24e7 None admin] PATH_INFO: `/v3/users/5700cdd86bd44b43a6a74ec88a185c9c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:49.837789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 83/167] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:49.841051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b41519-c5e7-4107-aa3e-3e735e2c24e7 None admin] RBAC: Authorizing `identity:get_user(user_id=5700cdd86bd44b43a6a74ec88a185c9c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:49.842515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b41519-c5e7-4107-aa3e-3e735e2c24e7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:49.843102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b306e4d-0e08-435b-ac02-f4c60da1dd12 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:49.843390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b306e4d-0e08-435b-ac02-f4c60da1dd12 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:49.843670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b306e4d-0e08-435b-ac02-f4c60da1dd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:49.844188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 85/168] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:49 2022] GET /identity/v3/users/5700cdd86bd44b43a6a74ec88a185c9c => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:49.849258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41519-c5e7-4107-aa3e-3e735e2c24e7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:49.873383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0b306e4d-0e08-435b-ac02-f4c60da1dd12 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:49.875126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0b306e4d-0e08-435b-ac02-f4c60da1dd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:49.901658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:49.991050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41519-c5e7-4107-aa3e-3e735e2c24e7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:49.991888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 84/169] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:49.992556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b306e4d-0e08-435b-ac02-f4c60da1dd12 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:50.049962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7c1e5-c5a6-4014-b317-936e5b3a16a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:50.050836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c1e5-c5a6-4014-b317-936e5b3a16a7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.051119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c1e5-c5a6-4014-b317-936e5b3a16a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.051396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c1e5-c5a6-4014-b317-936e5b3a16a7 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.054872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7c1e5-c5a6-4014-b317-936e5b3a16a7 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:50.056474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7c1e5-c5a6-4014-b317-936e5b3a16a7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:50.058430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 86/170] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:49 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:50.058984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7c1e5-c5a6-4014-b317-936e5b3a16a7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:50.194550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b306e4d-0e08-435b-ac02-f4c60da1dd12 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:50.231269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:50.255337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:50.278623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7c1e5-c5a6-4014-b317-936e5b3a16a7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:50.279377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939c99b-ffdd-40ac-a966-5a25b94b64a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:50.279858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939c99b-ffdd-40ac-a966-5a25b94b64a0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.280717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939c99b-ffdd-40ac-a966-5a25b94b64a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.281227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939c99b-ffdd-40ac-a966-5a25b94b64a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.350004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15dda-f128-4c72-80f8-cb7a8afec8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:50.351182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15dda-f128-4c72-80f8-cb7a8afec8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.351664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15dda-f128-4c72-80f8-cb7a8afec8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.352128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15dda-f128-4c72-80f8-cb7a8afec8e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.375572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff15dda-f128-4c72-80f8-cb7a8afec8e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5ff15dda-f128-4c72-80f8-cb7a8afec8e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:50.384478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:50.385360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:50.386145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:50.393910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 87/171] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:50.394592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15dda-f128-4c72-80f8-cb7a8afec8e1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:50.466744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939c99b-ffdd-40ac-a966-5a25b94b64a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:50.468758 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939c99b-ffdd-40ac-a966-5a25b94b64a0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:50.568365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15dda-f128-4c72-80f8-cb7a8afec8e1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:50.605414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 85/172] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:50.606419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939c99b-ffdd-40ac-a966-5a25b94b64a0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:50.618585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218dbcb-bace-47d4-9523-ae5d37df13a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:50.619514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218dbcb-bace-47d4-9523-ae5d37df13a2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.619906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218dbcb-bace-47d4-9523-ae5d37df13a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.620232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218dbcb-bace-47d4-9523-ae5d37df13a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.621441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218dbcb-bace-47d4-9523-ae5d37df13a2 None admin] RBAC: Adding query filter params (role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4, user.id=3a2b7d51d6c046db8fb911ffb0bedeeb) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:50.621778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218dbcb-bace-47d4-9523-ae5d37df13a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:50.623875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218dbcb-bace-47d4-9523-ae5d37df13a2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:50.633212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 88/173] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:50 2022] GET /identity/v3/role_assignments?user.id=3a2b7d51d6c046db8fb911ffb0bedeeb&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:50.633372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:50.633715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf424c2d-0958-4dd2-aed6-786360dfde29 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.634052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf424c2d-0958-4dd2-aed6-786360dfde29 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.634364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf424c2d-0958-4dd2-aed6-786360dfde29 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.635992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 89/174] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:50.637204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d667a-a6c5-4409-b279-f8db9d5194a0 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.637982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d667a-a6c5-4409-b279-f8db9d5194a0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.638301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d667a-a6c5-4409-b279-f8db9d5194a0 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.640243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 90/175] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:50.641065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d667a-a6c5-4409-b279-f8db9d5194a0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:50.674901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:50.827956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939c99b-ffdd-40ac-a966-5a25b94b64a0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:50.841918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d667a-a6c5-4409-b279-f8db9d5194a0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:50.874234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033a55e-2645-4280-a2cb-cdc229ac4b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:50.874915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a55e-2645-4280-a2cb-cdc229ac4b1e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.875199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a55e-2645-4280-a2cb-cdc229ac4b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.875477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a55e-2645-4280-a2cb-cdc229ac4b1e None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.876240 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033a55e-2645-4280-a2cb-cdc229ac4b1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:50.876584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033a55e-2645-4280-a2cb-cdc229ac4b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:50.878003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033a55e-2645-4280-a2cb-cdc229ac4b1e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:50.888357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 86/176] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:50.890007 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a247c0-bb95-4cd4-9123-79c084270fc9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.890363 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a247c0-bb95-4cd4-9123-79c084270fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.892132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a247c0-bb95-4cd4-9123-79c084270fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.934155 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-45a247c0-bb95-4cd4-9123-79c084270fc9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:50.936189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-45a247c0-bb95-4cd4-9123-79c084270fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:50.957320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59ded6-2283-4cdf-9dd3-cab4bde38e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:50.959430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ded6-2283-4cdf-9dd3-cab4bde38e5f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.959430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ded6-2283-4cdf-9dd3-cab4bde38e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.959430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ded6-2283-4cdf-9dd3-cab4bde38e5f None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.960635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59ded6-2283-4cdf-9dd3-cab4bde38e5f None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:50.962291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59ded6-2283-4cdf-9dd3-cab4bde38e5f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:50.970175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 91/177] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:50 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:50.970175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773816-eb81-406b-baf9-6d623476f77b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:50.970175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773816-eb81-406b-baf9-6d623476f77b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:50.970175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773816-eb81-406b-baf9-6d623476f77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:50.988004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f8773816-eb81-406b-baf9-6d623476f77b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:50.989236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f8773816-eb81-406b-baf9-6d623476f77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:51.019611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 87/178] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:51.021187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a247c0-bb95-4cd4-9123-79c084270fc9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.029298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:51.059059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 92/179] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:51.059354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357758ad-b9fe-4cb9-bcf5-43aaae1cc4d2 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.059633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357758ad-b9fe-4cb9-bcf5-43aaae1cc4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.059929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357758ad-b9fe-4cb9-bcf5-43aaae1cc4d2 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.061898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 93/180] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:51.065365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357758ad-b9fe-4cb9-bcf5-43aaae1cc4d2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.081922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:51.120496 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a247c0-bb95-4cd4-9123-79c084270fc9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.154342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53278b31-aaa1-45ef-9927-9f9251a7bd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:51.155244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53278b31-aaa1-45ef-9927-9f9251a7bd59 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.155557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53278b31-aaa1-45ef-9927-9f9251a7bd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.155834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53278b31-aaa1-45ef-9927-9f9251a7bd59 None admin] PATH_INFO: `/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.157037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53278b31-aaa1-45ef-9927-9f9251a7bd59 None admin] RBAC: Authorizing `identity:get_user(user_id=3a2b7d51d6c046db8fb911ffb0bedeeb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:51.158491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53278b31-aaa1-45ef-9927-9f9251a7bd59 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:51.160087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 88/181] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/users/3a2b7d51d6c046db8fb911ffb0bedeeb => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:51.161263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becff11-faf6-4de0-ac38-b938849365c9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.161542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becff11-faf6-4de0-ac38-b938849365c9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.161810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becff11-faf6-4de0-ac38-b938849365c9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.163022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 89/182] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:51.163705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becff11-faf6-4de0-ac38-b938849365c9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.176880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357758ad-b9fe-4cb9-bcf5-43aaae1cc4d2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.212927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5475f-606f-415e-80b0-c6e16969612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:51.213606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5475f-606f-415e-80b0-c6e16969612a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.213934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5475f-606f-415e-80b0-c6e16969612a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.214251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5475f-606f-415e-80b0-c6e16969612a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.215359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5475f-606f-415e-80b0-c6e16969612a None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4, user.id=5700cdd86bd44b43a6a74ec88a185c9c) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:51.215687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5475f-606f-415e-80b0-c6e16969612a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:51.217191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5475f-606f-415e-80b0-c6e16969612a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:51.223183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 94/183] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/role_assignments?user.id=5700cdd86bd44b43a6a74ec88a185c9c&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:51.224460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7b392-4ab9-4692-8e60-5ca3cc4c62f4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.224790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7b392-4ab9-4692-8e60-5ca3cc4c62f4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.225106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7b392-4ab9-4692-8e60-5ca3cc4c62f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.246824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-05f7b392-4ab9-4692-8e60-5ca3cc4c62f4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:51.248051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-05f7b392-4ab9-4692-8e60-5ca3cc4c62f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:51.250479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:51.279261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becff11-faf6-4de0-ac38-b938849365c9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.318351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234871-1b7f-488f-ac6a-01ba9f7e5c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:51.319479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234871-1b7f-488f-ac6a-01ba9f7e5c5f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.319943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234871-1b7f-488f-ac6a-01ba9f7e5c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.320422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234871-1b7f-488f-ac6a-01ba9f7e5c5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.325673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 95/184] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:51.326603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7b392-4ab9-4692-8e60-5ca3cc4c62f4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.338626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:51.345701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234871-1b7f-488f-ac6a-01ba9f7e5c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f7234871-1b7f-488f-ac6a-01ba9f7e5c5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:51.355282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:51.358702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 90/185] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:51.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234871-1b7f-488f-ac6a-01ba9f7e5c5f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.447164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7b392-4ab9-4692-8e60-5ca3cc4c62f4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.474887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234871-1b7f-488f-ac6a-01ba9f7e5c5f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.487334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07808ac8-e2bb-4716-8e89-220ada65b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:51.488439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07808ac8-e2bb-4716-8e89-220ada65b36a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.488721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07808ac8-e2bb-4716-8e89-220ada65b36a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.488999 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07808ac8-e2bb-4716-8e89-220ada65b36a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.498867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07808ac8-e2bb-4716-8e89-220ada65b36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-07808ac8-e2bb-4716-8e89-220ada65b36a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:51.506874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:51.507906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:51.508742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 96/186] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:51.509965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd7447-0b8a-4f61-b413-25178dffe5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:51.509965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd7447-0b8a-4f61-b413-25178dffe5dd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.510116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d79a2f-12ab-4942-8360-836d53294ecd None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.510181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd7447-0b8a-4f61-b413-25178dffe5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.510253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d79a2f-12ab-4942-8360-836d53294ecd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.510319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd7447-0b8a-4f61-b413-25178dffe5dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.510382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d79a2f-12ab-4942-8360-836d53294ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.512971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:51.525963 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a0d79a2f-12ab-4942-8360-836d53294ecd None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:51.528481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a0d79a2f-12ab-4942-8360-836d53294ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:51.578156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd7447-0b8a-4f61-b413-25178dffe5dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:51.579569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd7447-0b8a-4f61-b413-25178dffe5dd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:51.587187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:51.593102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 97/187] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:51.593698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d79a2f-12ab-4942-8360-836d53294ecd None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.678810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 91/188] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:51.679953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd7447-0b8a-4f61-b413-25178dffe5dd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.694909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d79a2f-12ab-4942-8360-836d53294ecd None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.711606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:51.729226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2586-2cea-479e-ac38-0396e9b319e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:51.730057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2586-2cea-479e-ac38-0396e9b319e6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.730333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2586-2cea-479e-ac38-0396e9b319e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.730604 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2586-2cea-479e-ac38-0396e9b319e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.731749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e2586-2cea-479e-ac38-0396e9b319e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:51.733845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e2586-2cea-479e-ac38-0396e9b319e6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:51.735473 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 98/189] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:51.737290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2586-2cea-479e-ac38-0396e9b319e6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.777328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd7447-0b8a-4f61-b413-25178dffe5dd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.803286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:51.812136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88bf8e-f01f-4f9e-8bf0-35cc63e3583c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:51.814251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88bf8e-f01f-4f9e-8bf0-35cc63e3583c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.814251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88bf8e-f01f-4f9e-8bf0-35cc63e3583c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.814251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88bf8e-f01f-4f9e-8bf0-35cc63e3583c None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.814251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88bf8e-f01f-4f9e-8bf0-35cc63e3583c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:51.814545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88bf8e-f01f-4f9e-8bf0-35cc63e3583c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:51.815791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88bf8e-f01f-4f9e-8bf0-35cc63e3583c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:51.823695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 92/190] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:51.824505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88bf8e-f01f-4f9e-8bf0-35cc63e3583c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.837634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2586-2cea-479e-ac38-0396e9b319e6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.871942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a22b2-f1a9-4af4-b123-6a452c2f28ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:51.872639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a22b2-f1a9-4af4-b123-6a452c2f28ae None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.872931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a22b2-f1a9-4af4-b123-6a452c2f28ae None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.873200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a22b2-f1a9-4af4-b123-6a452c2f28ae None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.873939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a22b2-f1a9-4af4-b123-6a452c2f28ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:51.874245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a22b2-f1a9-4af4-b123-6a452c2f28ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:51.875614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a22b2-f1a9-4af4-b123-6a452c2f28ae None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:51.883713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 99/191] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:51.884526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a22b2-f1a9-4af4-b123-6a452c2f28ae None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:51.921532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:51.927073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88bf8e-f01f-4f9e-8bf0-35cc63e3583c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.959121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebe15-5b16-4d3f-acc9-7dac3dde3a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:51.959923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebe15-5b16-4d3f-acc9-7dac3dde3a3c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:51.960211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebe15-5b16-4d3f-acc9-7dac3dde3a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:51.960524 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebe15-5b16-4d3f-acc9-7dac3dde3a3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:51.971023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ebe15-5b16-4d3f-acc9-7dac3dde3a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1b0ebe15-5b16-4d3f-acc9-7dac3dde3a3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:51.979079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:51.979975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:51.980969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 93/192] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:51.981626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a22b2-f1a9-4af4-b123-6a452c2f28ae None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:51.982176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebe15-5b16-4d3f-acc9-7dac3dde3a3c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:52.007630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:52.015711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a787381-8c75-4be9-ac49-8a441cc37d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:52.016585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a787381-8c75-4be9-ac49-8a441cc37d28 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:52.016869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a787381-8c75-4be9-ac49-8a441cc37d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:52.017144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a787381-8c75-4be9-ac49-8a441cc37d28 None admin] PATH_INFO: `/v3/projects/0b63af57c19e4154b0f42c8f590b42b9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:52.018319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a787381-8c75-4be9-ac49-8a441cc37d28 None admin] RBAC: Authorizing `identity:get_project(project_id=0b63af57c19e4154b0f42c8f590b42b9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:52.019756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a787381-8c75-4be9-ac49-8a441cc37d28 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:52.021528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 100/193] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:51 2022] GET /identity/v3/projects/0b63af57c19e4154b0f42c8f590b42b9 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:52.022207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a787381-8c75-4be9-ac49-8a441cc37d28 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:52.081051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebe15-5b16-4d3f-acc9-7dac3dde3a3c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:52.113565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8d126-c71b-4a34-a2ec-fd04d49d10f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:52.114160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8d126-c71b-4a34-a2ec-fd04d49d10f9 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:52.114441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8d126-c71b-4a34-a2ec-fd04d49d10f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:52.114719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8d126-c71b-4a34-a2ec-fd04d49d10f9 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:52.115426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8d126-c71b-4a34-a2ec-fd04d49d10f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:52.116941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8d126-c71b-4a34-a2ec-fd04d49d10f9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:52.119086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a787381-8c75-4be9-ac49-8a441cc37d28 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:52.151845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038916c-b4b8-4d5d-a711-e2186afeac46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:52.152732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038916c-b4b8-4d5d-a711-e2186afeac46 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:52.153045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038916c-b4b8-4d5d-a711-e2186afeac46 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:52.153321 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038916c-b4b8-4d5d-a711-e2186afeac46 None admin] PATH_INFO: `/v3/users/344ecdfa90634d1a941d528ec8386e79` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:52.154494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038916c-b4b8-4d5d-a711-e2186afeac46 None admin] RBAC: Authorizing `identity:get_user(user_id=344ecdfa90634d1a941d528ec8386e79)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:52.156544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038916c-b4b8-4d5d-a711-e2186afeac46 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:52.158150 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 101/194] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:52 2022] GET /identity/v3/users/344ecdfa90634d1a941d528ec8386e79 => generated 289 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:52.158985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038916c-b4b8-4d5d-a711-e2186afeac46 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:52.218225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:52.222832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 94/195] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:03:51 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:52.233935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8d126-c71b-4a34-a2ec-fd04d49d10f9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:52.252908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:52.259118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038916c-b4b8-4d5d-a711-e2186afeac46 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:52.300368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae1eab-b26b-488e-8f0e-d1ac717ff1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:52.301468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae1eab-b26b-488e-8f0e-d1ac717ff1ec None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:52.301806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae1eab-b26b-488e-8f0e-d1ac717ff1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:52.302086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae1eab-b26b-488e-8f0e-d1ac717ff1ec None admin] PATH_INFO: `/v3/users/0ab4e0f30444423dbe587709d78ebb2a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:52.317805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae1eab-b26b-488e-8f0e-d1ac717ff1ec None admin] RBAC: Authorizing `identity:get_user(user_id=0ab4e0f30444423dbe587709d78ebb2a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:52.319298 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae1eab-b26b-488e-8f0e-d1ac717ff1ec None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:52.321101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 102/196] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:52 2022] GET /identity/v3/users/0ab4e0f30444423dbe587709d78ebb2a => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:52.321101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae1eab-b26b-488e-8f0e-d1ac717ff1ec None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:52.351813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8d126-c71b-4a34-a2ec-fd04d49d10f9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:52.390188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784f767-61cf-4d78-af7b-89ec48fc6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:52.390790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784f767-61cf-4d78-af7b-89ec48fc6b1a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:52.391067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784f767-61cf-4d78-af7b-89ec48fc6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:52.391346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784f767-61cf-4d78-af7b-89ec48fc6b1a None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:52.392113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784f767-61cf-4d78-af7b-89ec48fc6b1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:52.392447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784f767-61cf-4d78-af7b-89ec48fc6b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:52.393902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784f767-61cf-4d78-af7b-89ec48fc6b1a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:52.402823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 95/197] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:03:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:52.403488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784f767-61cf-4d78-af7b-89ec48fc6b1a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:52.447210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae1eab-b26b-488e-8f0e-d1ac717ff1ec None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:52.474459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:52.488006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9194a31-d35e-49cf-b581-a4776b925860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:52.488006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9194a31-d35e-49cf-b581-a4776b925860 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:52.488428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9194a31-d35e-49cf-b581-a4776b925860 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:52.488689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9194a31-d35e-49cf-b581-a4776b925860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:52.489627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9194a31-d35e-49cf-b581-a4776b925860 None admin] RBAC: Adding query filter params (role.id=64789f5937034a188d1774823d2387cb, scope.project.id=0b63af57c19e4154b0f42c8f590b42b9, user.id=3a2b7d51d6c046db8fb911ffb0bedeeb) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:52.489948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9194a31-d35e-49cf-b581-a4776b925860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:52.492126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9194a31-d35e-49cf-b581-a4776b925860 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:52.493586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:52.501500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 103/198] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:52 2022] GET /identity/v3/role_assignments?user.id=3a2b7d51d6c046db8fb911ffb0bedeeb&scope.project.id=0b63af57c19e4154b0f42c8f590b42b9&role.id=64789f5937034a188d1774823d2387cb => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:52.502148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9194a31-d35e-49cf-b581-a4776b925860 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:52.530705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784f767-61cf-4d78-af7b-89ec48fc6b1a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:52.584015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20222b59-3bce-402a-986b-997b8f8111e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:52.584818 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20222b59-3bce-402a-986b-997b8f8111e7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:52.585102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20222b59-3bce-402a-986b-997b8f8111e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:52.585378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20222b59-3bce-402a-986b-997b8f8111e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:52.645459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9194a31-d35e-49cf-b581-a4776b925860 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:52.680339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20222b59-3bce-402a-986b-997b8f8111e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:52.682188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20222b59-3bce-402a-986b-997b8f8111e7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:52.730190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0601b-cd7a-4a46-be87-38f75ec9517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:52.730864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0601b-cd7a-4a46-be87-38f75ec9517a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:52.731147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0601b-cd7a-4a46-be87-38f75ec9517a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:52.731421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0601b-cd7a-4a46-be87-38f75ec9517a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:52.780415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:52.802988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:52.816977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 96/199] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:52.818498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20222b59-3bce-402a-986b-997b8f8111e7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:52.820576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0601b-cd7a-4a46-be87-38f75ec9517a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:52.822482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0601b-cd7a-4a46-be87-38f75ec9517a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:52.940515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 104/200] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:52.942383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0601b-cd7a-4a46-be87-38f75ec9517a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:52.950788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20222b59-3bce-402a-986b-997b8f8111e7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:53.004519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec852-2ed4-430c-a351-30914bdd829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:53.005809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec852-2ed4-430c-a351-30914bdd829e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:53.006273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec852-2ed4-430c-a351-30914bdd829e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:53.006730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec852-2ed4-430c-a351-30914bdd829e None admin] PATH_INFO: `/v3/users/0ab4e0f30444423dbe587709d78ebb2a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:53.008142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec852-2ed4-430c-a351-30914bdd829e None admin] RBAC: Authorizing `identity:get_user(user_id=0ab4e0f30444423dbe587709d78ebb2a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:53.009841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec852-2ed4-430c-a351-30914bdd829e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:53.011964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 97/201] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:52 2022] GET /identity/v3/users/0ab4e0f30444423dbe587709d78ebb2a => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:53.013005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec852-2ed4-430c-a351-30914bdd829e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:53.065980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:53.082630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0601b-cd7a-4a46-be87-38f75ec9517a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:53.093006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:53.118548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1671d-e909-4051-b017-5fbeda6a5028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:53.119701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1671d-e909-4051-b017-5fbeda6a5028 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:53.119824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1671d-e909-4051-b017-5fbeda6a5028 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:53.120148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1671d-e909-4051-b017-5fbeda6a5028 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:53.121427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1671d-e909-4051-b017-5fbeda6a5028 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:53.123020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1671d-e909-4051-b017-5fbeda6a5028 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:53.130191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 105/202] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:52 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:53.130994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec852-2ed4-430c-a351-30914bdd829e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:53.131107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1671d-e909-4051-b017-5fbeda6a5028 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:53.171474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96644753-23a9-4027-b61d-ec401d6f4c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:53.172748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96644753-23a9-4027-b61d-ec401d6f4c82 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:53.173215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96644753-23a9-4027-b61d-ec401d6f4c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:53.173690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96644753-23a9-4027-b61d-ec401d6f4c82 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:53.175182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96644753-23a9-4027-b61d-ec401d6f4c82 None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:53.176975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96644753-23a9-4027-b61d-ec401d6f4c82 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:53.179202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 98/203] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:53 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:53.180260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96644753-23a9-4027-b61d-ec401d6f4c82 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:53.241183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1671d-e909-4051-b017-5fbeda6a5028 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:53.275211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf2ded-d896-4b80-beeb-ac114f318610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:53.275978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf2ded-d896-4b80-beeb-ac114f318610 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:53.276339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf2ded-d896-4b80-beeb-ac114f318610 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:53.276787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf2ded-d896-4b80-beeb-ac114f318610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:53.289630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96644753-23a9-4027-b61d-ec401d6f4c82 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:53.302183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:53.304732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:53.328116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bee53-13aa-4195-bc8a-a6dd0465ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:53.329123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bee53-13aa-4195-bc8a-a6dd0465ba45 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:53.329787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bee53-13aa-4195-bc8a-a6dd0465ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:53.330248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bee53-13aa-4195-bc8a-a6dd0465ba45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:53.331327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bee53-13aa-4195-bc8a-a6dd0465ba45 None admin] RBAC: Adding query filter params (role.id=c398a9e080af4ba68f03ea9f28debb38, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4, user.id=344ecdfa90634d1a941d528ec8386e79) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:53.331846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bee53-13aa-4195-bc8a-a6dd0465ba45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:53.333626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bee53-13aa-4195-bc8a-a6dd0465ba45 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:53.341970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 99/204] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:53 2022] GET /identity/v3/role_assignments?user.id=344ecdfa90634d1a941d528ec8386e79&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=c398a9e080af4ba68f03ea9f28debb38 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:53.343570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bee53-13aa-4195-bc8a-a6dd0465ba45 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:53.355296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf2ded-d896-4b80-beeb-ac114f318610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:53.365142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf2ded-d896-4b80-beeb-ac114f318610 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:53.458531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bee53-13aa-4195-bc8a-a6dd0465ba45 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:53.470264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 106/205] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:53.475900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf2ded-d896-4b80-beeb-ac114f318610 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:53.498158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75863487-1876-41d5-83f2-f87cfc58d742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:53.499531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75863487-1876-41d5-83f2-f87cfc58d742 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:53.500004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75863487-1876-41d5-83f2-f87cfc58d742 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:53.500508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75863487-1876-41d5-83f2-f87cfc58d742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:53.501589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75863487-1876-41d5-83f2-f87cfc58d742 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=6da20a2c16864901ae4e4966a4f38536, user.id=0ab4e0f30444423dbe587709d78ebb2a) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:53.502110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75863487-1876-41d5-83f2-f87cfc58d742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:53.503960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75863487-1876-41d5-83f2-f87cfc58d742 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:53.510811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 100/206] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:53 2022] GET /identity/v3/role_assignments?user.id=0ab4e0f30444423dbe587709d78ebb2a&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:53.567523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:53.643059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf2ded-d896-4b80-beeb-ac114f318610 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:53.687041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4345-6f1c-43be-8283-60498e907c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:53.688801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4345-6f1c-43be-8283-60498e907c4f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:53.689306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4345-6f1c-43be-8283-60498e907c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:53.689764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4345-6f1c-43be-8283-60498e907c4f None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:53.691367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4345-6f1c-43be-8283-60498e907c4f None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:53.693124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4345-6f1c-43be-8283-60498e907c4f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:53.695341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 107/207] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:53 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:53.701233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75863487-1876-41d5-83f2-f87cfc58d742 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:53.751873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:53.821338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75863487-1876-41d5-83f2-f87cfc58d742 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:53.861235 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd470-caf8-40e0-8ab1-d12ee7317410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:53.861900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd470-caf8-40e0-8ab1-d12ee7317410 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:53.862184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd470-caf8-40e0-8ab1-d12ee7317410 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:53.862457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd470-caf8-40e0-8ab1-d12ee7317410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:53.863307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd470-caf8-40e0-8ab1-d12ee7317410 None admin] RBAC: Adding query filter params (role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=6da20a2c16864901ae4e4966a4f38536, user.id=0ab4e0f30444423dbe587709d78ebb2a) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:53.863622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd470-caf8-40e0-8ab1-d12ee7317410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:53.865109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd470-caf8-40e0-8ab1-d12ee7317410 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:53.871301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 101/208] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:53 2022] GET /identity/v3/role_assignments?user.id=0ab4e0f30444423dbe587709d78ebb2a&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:54.814979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eef99-4143-4225-9325-cae7e64c9bb9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:54.816003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eef99-4143-4225-9325-cae7e64c9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:54.823080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eef99-4143-4225-9325-cae7e64c9bb9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:54.823080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 108/209] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:54.824283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bb458-a636-4bf2-9b10-bb9921b59c74 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:54.825130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bb458-a636-4bf2-9b10-bb9921b59c74 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:54.825608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bb458-a636-4bf2-9b10-bb9921b59c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:54.844356 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-866bb458-a636-4bf2-9b10-bb9921b59c74 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:54.845858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-866bb458-a636-4bf2-9b10-bb9921b59c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:54.921375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 102/210] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:54.945363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eef99-4143-4225-9325-cae7e64c9bb9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:54.964088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c047-2608-44ed-91d5-73b3b9547fc4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:54.964414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c047-2608-44ed-91d5-73b3b9547fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:54.964960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c047-2608-44ed-91d5-73b3b9547fc4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:54.966339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 103/211] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:03:54.971698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c57c-227e-4456-b452-bb7841ae66fd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:54.971985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c57c-227e-4456-b452-bb7841ae66fd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:54.972264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4c57c-227e-4456-b452-bb7841ae66fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:54.994972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a2f4c57c-227e-4456-b452-bb7841ae66fd None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:54.997013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a2f4c57c-227e-4456-b452-bb7841ae66fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:55.032613 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:55.073618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eef99-4143-4225-9325-cae7e64c9bb9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:55.080343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 104/212] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:55.108287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:55.110314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4c57c-227e-4456-b452-bb7841ae66fd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:55.121168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0bef2-4ee3-4981-b60d-bdf3f05d75ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:55.121989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0bef2-4ee3-4981-b60d-bdf3f05d75ca None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:55.122276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0bef2-4ee3-4981-b60d-bdf3f05d75ca None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:55.123050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0bef2-4ee3-4981-b60d-bdf3f05d75ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:55.135179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0bef2-4ee3-4981-b60d-bdf3f05d75ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c7d0bef2-4ee3-4981-b60d-bdf3f05d75ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:55.145925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:55.146998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:55.147978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:55.151033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 109/213] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:55.159166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0bef2-4ee3-4981-b60d-bdf3f05d75ca None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:55.221234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4c57c-227e-4456-b452-bb7841ae66fd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:55.255064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c17024-eca9-4228-b3f7-73c32884b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:55.255851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c17024-eca9-4228-b3f7-73c32884b2aa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:55.256133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c17024-eca9-4228-b3f7-73c32884b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:55.256434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c17024-eca9-4228-b3f7-73c32884b2aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:55.257593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c17024-eca9-4228-b3f7-73c32884b2aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:55.259380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c17024-eca9-4228-b3f7-73c32884b2aa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:55.260907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 105/214] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:55.266500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c17024-eca9-4228-b3f7-73c32884b2aa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:55.273495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0bef2-4ee3-4981-b60d-bdf3f05d75ca None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:55.296703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:55.312548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cfc42-1dc2-486f-8e9b-27d809102772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:55.313548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cfc42-1dc2-486f-8e9b-27d809102772 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:55.314034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cfc42-1dc2-486f-8e9b-27d809102772 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:55.314509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cfc42-1dc2-486f-8e9b-27d809102772 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:55.315475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cfc42-1dc2-486f-8e9b-27d809102772 None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:55.315984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cfc42-1dc2-486f-8e9b-27d809102772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:55.317672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cfc42-1dc2-486f-8e9b-27d809102772 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:55.331936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 110/215] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:55.334743 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cfc42-1dc2-486f-8e9b-27d809102772 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:55.367050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c17024-eca9-4228-b3f7-73c32884b2aa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:55.386249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:55.401933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fca65-8149-4c17-a8b5-5fb18ac8c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:55.402605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fca65-8149-4c17-a8b5-5fb18ac8c4e4 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:55.402890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fca65-8149-4c17-a8b5-5fb18ac8c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:55.403167 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fca65-8149-4c17-a8b5-5fb18ac8c4e4 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:55.404090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fca65-8149-4c17-a8b5-5fb18ac8c4e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:55.406111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fca65-8149-4c17-a8b5-5fb18ac8c4e4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:55.453786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cfc42-1dc2-486f-8e9b-27d809102772 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:55.482573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 106/216] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:03:55 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:03:55.496871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028423e-a127-411b-b9d2-019364fdb8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:55.497891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028423e-a127-411b-b9d2-019364fdb8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:55.498253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028423e-a127-411b-b9d2-019364fdb8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:55.499224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028423e-a127-411b-b9d2-019364fdb8e5 None admin] PATH_INFO: `/v3/users/c02e70d9f4b9452a9217f7dc0dcb5387` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:55.517809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028423e-a127-411b-b9d2-019364fdb8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=c02e70d9f4b9452a9217f7dc0dcb5387)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:55.519573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028423e-a127-411b-b9d2-019364fdb8e5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:55.521660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 111/217] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:55 2022] GET /identity/v3/users/c02e70d9f4b9452a9217f7dc0dcb5387 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:55.527347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fca65-8149-4c17-a8b5-5fb18ac8c4e4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:55.628660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:55.644295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fca65-8149-4c17-a8b5-5fb18ac8c4e4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:55.681819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54c324-632e-470c-ada8-6d512849bb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:55.682501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c324-632e-470c-ada8-6d512849bb1b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:55.682784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c324-632e-470c-ada8-6d512849bb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:55.683060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c324-632e-470c-ada8-6d512849bb1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:55.759287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54c324-632e-470c-ada8-6d512849bb1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:55.761552 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54c324-632e-470c-ada8-6d512849bb1b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:55.853897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:55.870477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 107/218] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:03:55.876675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028423e-a127-411b-b9d2-019364fdb8e5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:55.887620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64af0d5-a9d8-4f7c-8b27-af9cb3a02a90 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:55.888123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64af0d5-a9d8-4f7c-8b27-af9cb3a02a90 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:55.889318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64af0d5-a9d8-4f7c-8b27-af9cb3a02a90 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:55.890015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 108/219] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:03:55.895105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07777ee2-5805-4569-9624-56d55903e71b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:55.895402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07777ee2-5805-4569-9624-56d55903e71b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:55.895683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07777ee2-5805-4569-9624-56d55903e71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:55.913732 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-07777ee2-5805-4569-9624-56d55903e71b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:55.914932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-07777ee2-5805-4569-9624-56d55903e71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:56.006272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028423e-a127-411b-b9d2-019364fdb8e5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:56.007795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 109/220] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:56.012903 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:56.035838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07777ee2-5805-4569-9624-56d55903e71b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:56.050844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9917e-b6d3-4a26-a0b8-5095ad9b841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:56.051716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9917e-b6d3-4a26-a0b8-5095ad9b841c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.052000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9917e-b6d3-4a26-a0b8-5095ad9b841c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.052273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9917e-b6d3-4a26-a0b8-5095ad9b841c None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.053516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9917e-b6d3-4a26-a0b8-5095ad9b841c None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:56.055338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9917e-b6d3-4a26-a0b8-5095ad9b841c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:56.057396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 112/221] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:55 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:56.063866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9917e-b6d3-4a26-a0b8-5095ad9b841c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:56.182241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07777ee2-5805-4569-9624-56d55903e71b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:56.199056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:56.207394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9917e-b6d3-4a26-a0b8-5095ad9b841c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:56.218983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32d63-7fce-422c-a662-b0c05a507e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:56.220007 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32d63-7fce-422c-a662-b0c05a507e02 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.220490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32d63-7fce-422c-a662-b0c05a507e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.223035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32d63-7fce-422c-a662-b0c05a507e02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.236892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b32d63-7fce-422c-a662-b0c05a507e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-52b32d63-7fce-422c-a662-b0c05a507e02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:56.247749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:56.248919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:03:56.249897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:56.252099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 110/222] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:03:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:03:56.252867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c86832-272c-40fc-9ee6-c9bc52e95080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:56.253647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ba06-e4fd-49a8-805f-d717a24f93f9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.254138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c86832-272c-40fc-9ee6-c9bc52e95080 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.254451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ba06-e4fd-49a8-805f-d717a24f93f9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.254720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c86832-272c-40fc-9ee6-c9bc52e95080 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.254939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ba06-e4fd-49a8-805f-d717a24f93f9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.255325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c86832-272c-40fc-9ee6-c9bc52e95080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.256387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c86832-272c-40fc-9ee6-c9bc52e95080 None admin] RBAC: Adding query filter params (role.id=64789f5937034a188d1774823d2387cb, scope.project.id=6da20a2c16864901ae4e4966a4f38536, user.id=c02e70d9f4b9452a9217f7dc0dcb5387) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:56.256501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 111/223] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:56.256949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c86832-272c-40fc-9ee6-c9bc52e95080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:56.258019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350ba06-e4fd-49a8-805f-d717a24f93f9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:56.258844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c86832-272c-40fc-9ee6-c9bc52e95080 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:56.266179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 113/224] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:03:56 2022] GET /identity/v3/role_assignments?user.id=c02e70d9f4b9452a9217f7dc0dcb5387&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=64789f5937034a188d1774823d2387cb => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:56.272373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb7245-310b-4450-878a-92fc6fb254fe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.273156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb7245-310b-4450-878a-92fc6fb254fe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.273614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb7245-310b-4450-878a-92fc6fb254fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.307160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d7bb7245-310b-4450-878a-92fc6fb254fe None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:56.308841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d7bb7245-310b-4450-878a-92fc6fb254fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:56.373181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:56.384876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350ba06-e4fd-49a8-805f-d717a24f93f9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:56.432147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 114/225] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:56.432841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5108d-d3a6-4fc0-b7b6-4df5a5212650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:56.433702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5108d-d3a6-4fc0-b7b6-4df5a5212650 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.433988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5108d-d3a6-4fc0-b7b6-4df5a5212650 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.434268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5108d-d3a6-4fc0-b7b6-4df5a5212650 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.435023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5108d-d3a6-4fc0-b7b6-4df5a5212650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:56.435336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5108d-d3a6-4fc0-b7b6-4df5a5212650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:56.443338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5108d-d3a6-4fc0-b7b6-4df5a5212650 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:56.447218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 112/226] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:56.452844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb7245-310b-4450-878a-92fc6fb254fe None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:56.458620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5108d-d3a6-4fc0-b7b6-4df5a5212650 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:56.536692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:56.582221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5108d-d3a6-4fc0-b7b6-4df5a5212650 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:56.620525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeca0a-f8e6-4ed1-9fee-82a055ba16ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:56.621342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeca0a-f8e6-4ed1-9fee-82a055ba16ff None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.621628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeca0a-f8e6-4ed1-9fee-82a055ba16ff None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.621905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeca0a-f8e6-4ed1-9fee-82a055ba16ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.622214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb7245-310b-4450-878a-92fc6fb254fe None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:56.633837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeca0a-f8e6-4ed1-9fee-82a055ba16ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-42eeca0a-f8e6-4ed1-9fee-82a055ba16ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:56.643198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:56.644142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:03:56.645000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:56.645624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 113/227] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:03:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:56.650646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeca0a-f8e6-4ed1-9fee-82a055ba16ff None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:56.737071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566b105-00a8-4ba9-b772-96698255cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:56.737931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b105-00a8-4ba9-b772-96698255cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.738216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b105-00a8-4ba9-b772-96698255cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.738488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b105-00a8-4ba9-b772-96698255cd92 None admin] PATH_INFO: `/v3/users/0ab4e0f30444423dbe587709d78ebb2a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.743896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566b105-00a8-4ba9-b772-96698255cd92 None admin] RBAC: Authorizing `identity:get_user(user_id=0ab4e0f30444423dbe587709d78ebb2a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:56.745402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566b105-00a8-4ba9-b772-96698255cd92 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:56.747054 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 115/228] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:56 2022] GET /identity/v3/users/0ab4e0f30444423dbe587709d78ebb2a => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:56.752716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566b105-00a8-4ba9-b772-96698255cd92 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:56.755158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:56.761022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeca0a-f8e6-4ed1-9fee-82a055ba16ff None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:56.803255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f384e6-923e-473c-8425-d3a5a6e18bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:56.804112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f384e6-923e-473c-8425-d3a5a6e18bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.804430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f384e6-923e-473c-8425-d3a5a6e18bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.804711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f384e6-923e-473c-8425-d3a5a6e18bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.805467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f384e6-923e-473c-8425-d3a5a6e18bf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:56.805777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f384e6-923e-473c-8425-d3a5a6e18bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:56.807190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f384e6-923e-473c-8425-d3a5a6e18bf7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:56.815599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:56.817328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 114/229] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:03:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:56.822816 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f384e6-923e-473c-8425-d3a5a6e18bf7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:56.940678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f384e6-923e-473c-8425-d3a5a6e18bf7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:56.975559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682a050-1cd1-4cbe-8aa5-8f04b62bfa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:56.976491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682a050-1cd1-4cbe-8aa5-8f04b62bfa45 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:56.976777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682a050-1cd1-4cbe-8aa5-8f04b62bfa45 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:56.977057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682a050-1cd1-4cbe-8aa5-8f04b62bfa45 None admin] PATH_INFO: `/v3/users/0ab4e0f30444423dbe587709d78ebb2a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:56.978249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682a050-1cd1-4cbe-8aa5-8f04b62bfa45 None admin] RBAC: Authorizing `identity:get_user(user_id=0ab4e0f30444423dbe587709d78ebb2a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:56.979863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682a050-1cd1-4cbe-8aa5-8f04b62bfa45 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:56.981802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 115/230] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:56 2022] GET /identity/v3/users/0ab4e0f30444423dbe587709d78ebb2a => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:56.987405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682a050-1cd1-4cbe-8aa5-8f04b62bfa45 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:57.006181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566b105-00a8-4ba9-b772-96698255cd92 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:57.028736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:57.054763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa684d5c-f812-4ad9-a126-b8029dec1836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:57.055625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa684d5c-f812-4ad9-a126-b8029dec1836 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:57.055904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa684d5c-f812-4ad9-a126-b8029dec1836 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:57.056177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa684d5c-f812-4ad9-a126-b8029dec1836 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:57.057376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa684d5c-f812-4ad9-a126-b8029dec1836 None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:57.058803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa684d5c-f812-4ad9-a126-b8029dec1836 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:57.060840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 116/231] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:56 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:57.067585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa684d5c-f812-4ad9-a126-b8029dec1836 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:57.161273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682a050-1cd1-4cbe-8aa5-8f04b62bfa45 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:57.226333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa684d5c-f812-4ad9-a126-b8029dec1836 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:57.261332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:57.262198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9db3b-3301-4846-8ec3-f76829d9660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:57.262997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b3131-06bd-4e28-bab1-93a3c7c752f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:57.263151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9db3b-3301-4846-8ec3-f76829d9660e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:57.264059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9db3b-3301-4846-8ec3-f76829d9660e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:57.264059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9db3b-3301-4846-8ec3-f76829d9660e None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:57.264921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b3131-06bd-4e28-bab1-93a3c7c752f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:57.265257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b3131-06bd-4e28-bab1-93a3c7c752f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:57.265629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b3131-06bd-4e28-bab1-93a3c7c752f6 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536/users/0ab4e0f30444423dbe587709d78ebb2a/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:57.267666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9db3b-3301-4846-8ec3-f76829d9660e None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:57.267923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b3131-06bd-4e28-bab1-93a3c7c752f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6da20a2c16864901ae4e4966a4f38536, user_id=0ab4e0f30444423dbe587709d78ebb2a, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:57.269171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9db3b-3301-4846-8ec3-f76829d9660e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:57.273350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b3131-06bd-4e28-bab1-93a3c7c752f6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:57.273463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 116/232] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:56 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:57.276756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9db3b-3301-4846-8ec3-f76829d9660e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:57.360448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 117/233] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:03:57 2022] PUT /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536/users/0ab4e0f30444423dbe587709d78ebb2a/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:03:57.392543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:57.400302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9db3b-3301-4846-8ec3-f76829d9660e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:57.443249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ecc94-9f6d-4d45-abd6-fdca5fe04cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:57.444216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ecc94-9f6d-4d45-abd6-fdca5fe04cf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:57.444578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ecc94-9f6d-4d45-abd6-fdca5fe04cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:57.444855 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ecc94-9f6d-4d45-abd6-fdca5fe04cf7 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536/users/0ab4e0f30444423dbe587709d78ebb2a/roles/90baedc1773f4d67ae7e85fa74a93b5d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:57.447164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ecc94-9f6d-4d45-abd6-fdca5fe04cf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6da20a2c16864901ae4e4966a4f38536, user_id=0ab4e0f30444423dbe587709d78ebb2a, role_id=90baedc1773f4d67ae7e85fa74a93b5d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:57.448703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ecc94-9f6d-4d45-abd6-fdca5fe04cf7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:57.554923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 117/234] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:03:57 2022] PUT /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536/users/0ab4e0f30444423dbe587709d78ebb2a/roles/90baedc1773f4d67ae7e85fa74a93b5d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:03:58.409097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd684b9b-2df1-4e20-9c8d-c5e162b077be None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:58.409611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd684b9b-2df1-4e20-9c8d-c5e162b077be None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:58.409714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd684b9b-2df1-4e20-9c8d-c5e162b077be None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:58.411007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 118/235] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:03:58.416721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae6ad6-df85-42bc-a589-a94e41120291 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:58.417161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae6ad6-df85-42bc-a589-a94e41120291 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:58.417340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae6ad6-df85-42bc-a589-a94e41120291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:58.441360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-80ae6ad6-df85-42bc-a589-a94e41120291 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:58.442551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-80ae6ad6-df85-42bc-a589-a94e41120291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:58.470289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cb0ff-7e62-4296-b204-4bdc9b56df8e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:58.470588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cb0ff-7e62-4296-b204-4bdc9b56df8e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:58.470856 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cb0ff-7e62-4296-b204-4bdc9b56df8e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:58.472518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 119/236] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:03:58.481700 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156bce9-f485-4d97-b70f-da8db662c5a5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:58.481996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156bce9-f485-4d97-b70f-da8db662c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:58.482278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156bce9-f485-4d97-b70f-da8db662c5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:58.506299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e156bce9-f485-4d97-b70f-da8db662c5a5 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:58.507487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e156bce9-f485-4d97-b70f-da8db662c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:58.549684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 118/237] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:58.592196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae6ad6-df85-42bc-a589-a94e41120291 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:58.595939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 120/238] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:03:58.669825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156bce9-f485-4d97-b70f-da8db662c5a5 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:58.747104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:58.786852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156bce9-f485-4d97-b70f-da8db662c5a5 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:58.812090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae6ad6-df85-42bc-a589-a94e41120291 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:58.816733 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:58.831242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40052e-d54e-4622-af47-8d7d9cbfd157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:58.832048 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40052e-d54e-4622-af47-8d7d9cbfd157 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:58.832359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40052e-d54e-4622-af47-8d7d9cbfd157 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:58.832649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40052e-d54e-4622-af47-8d7d9cbfd157 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:58.845646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40052e-d54e-4622-af47-8d7d9cbfd157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5a40052e-d54e-4622-af47-8d7d9cbfd157 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:58.854788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:58.855694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:03:58.856977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 121/239] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:03:58.864050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40052e-d54e-4622-af47-8d7d9cbfd157 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:58.887038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7ca0d-ac33-4a5b-a70a-7edc2da8c76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:58.887846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7ca0d-ac33-4a5b-a70a-7edc2da8c76d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:58.888134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7ca0d-ac33-4a5b-a70a-7edc2da8c76d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:58.888453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7ca0d-ac33-4a5b-a70a-7edc2da8c76d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:58.889664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7ca0d-ac33-4a5b-a70a-7edc2da8c76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:58.891185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7ca0d-ac33-4a5b-a70a-7edc2da8c76d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:58.893060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 119/240] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:03:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:58.896804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93103a-5c49-4b07-aa16-8c7a3273a195 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:58.897079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93103a-5c49-4b07-aa16-8c7a3273a195 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:58.897354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93103a-5c49-4b07-aa16-8c7a3273a195 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:58.898731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 120/241] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:03:58.899293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93103a-5c49-4b07-aa16-8c7a3273a195 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:59.021414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40052e-d54e-4622-af47-8d7d9cbfd157 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:59.037026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93103a-5c49-4b07-aa16-8c7a3273a195 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:59.059096 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2159f0-6b5f-4fc1-8d41-828a6386b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:59.059830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2159f0-6b5f-4fc1-8d41-828a6386b769 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:59.060121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2159f0-6b5f-4fc1-8d41-828a6386b769 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:59.060447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2159f0-6b5f-4fc1-8d41-828a6386b769 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:59.061869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2159f0-6b5f-4fc1-8d41-828a6386b769 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:59.062183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2159f0-6b5f-4fc1-8d41-828a6386b769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:59.063627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2159f0-6b5f-4fc1-8d41-828a6386b769 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:59.073132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 122/242] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:59.074462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a02e9c-2b94-4c9b-b0cf-d0815e6168a2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:59.074754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a02e9c-2b94-4c9b-b0cf-d0815e6168a2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:59.075034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a02e9c-2b94-4c9b-b0cf-d0815e6168a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:59.080347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9eaf3-40d4-4f47-be20-72b699f6d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:59.080548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9eaf3-40d4-4f47-be20-72b699f6d07a None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:59.080891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9eaf3-40d4-4f47-be20-72b699f6d07a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:59.081170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9eaf3-40d4-4f47-be20-72b699f6d07a None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:59.082236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9eaf3-40d4-4f47-be20-72b699f6d07a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:59.084801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9eaf3-40d4-4f47-be20-72b699f6d07a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:59.094674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a0a02e9c-2b94-4c9b-b0cf-d0815e6168a2 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:03:59.096050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a0a02e9c-2b94-4c9b-b0cf-d0815e6168a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:03:59.104662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:59.164235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 123/243] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:03:59.165366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a02e9c-2b94-4c9b-b0cf-d0815e6168a2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:59.174772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 121/244] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:03:58 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:03:59.193435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9eaf3-40d4-4f47-be20-72b699f6d07a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:59.208993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:59.306609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9eaf3-40d4-4f47-be20-72b699f6d07a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:59.345613 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a370d9-2bbb-4ece-a00f-27239c833a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:59.346805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a370d9-2bbb-4ece-a00f-27239c833a59 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:59.347481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a370d9-2bbb-4ece-a00f-27239c833a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:59.347970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a370d9-2bbb-4ece-a00f-27239c833a59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:59.361225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a370d9-2bbb-4ece-a00f-27239c833a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c5a370d9-2bbb-4ece-a00f-27239c833a59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:03:59.370067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:03:59.371023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:03:59.371809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:03:59.379290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 122/245] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:03:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:03:59.381105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a370d9-2bbb-4ece-a00f-27239c833a59 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:59.387913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a02e9c-2b94-4c9b-b0cf-d0815e6168a2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:59.465484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:59.471379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ef10d-9d58-460d-ae6b-30229ab8689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:59.472885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ef10d-9d58-460d-ae6b-30229ab8689b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:59.473317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ef10d-9d58-460d-ae6b-30229ab8689b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:59.473761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ef10d-9d58-460d-ae6b-30229ab8689b None admin] PATH_INFO: `/v3/users/9f50500720e54e8b8166b5b9e67a2085` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:59.488286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:59.490869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ef10d-9d58-460d-ae6b-30229ab8689b None admin] RBAC: Authorizing `identity:get_user(user_id=9f50500720e54e8b8166b5b9e67a2085)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:59.492481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ef10d-9d58-460d-ae6b-30229ab8689b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:59.494289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 124/246] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:59 2022] GET /identity/v3/users/9f50500720e54e8b8166b5b9e67a2085 => generated 297 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:59.499636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ef10d-9d58-460d-ae6b-30229ab8689b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:59.510310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a370d9-2bbb-4ece-a00f-27239c833a59 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:59.563174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773fb7f-ab6f-4f5c-af1e-fd7b85af5483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:59.563789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773fb7f-ab6f-4f5c-af1e-fd7b85af5483 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:59.564076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773fb7f-ab6f-4f5c-af1e-fd7b85af5483 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:59.564403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773fb7f-ab6f-4f5c-af1e-fd7b85af5483 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:59.565283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773fb7f-ab6f-4f5c-af1e-fd7b85af5483 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:03:59.565593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773fb7f-ab6f-4f5c-af1e-fd7b85af5483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:59.567013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773fb7f-ab6f-4f5c-af1e-fd7b85af5483 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:59.581084 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 123/247] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:03:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:03:59.585069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773fb7f-ab6f-4f5c-af1e-fd7b85af5483 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:59.642017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ef10d-9d58-460d-ae6b-30229ab8689b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:59.679858 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18e883-5b53-42f5-9fff-5c6d53396b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:59.681006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18e883-5b53-42f5-9fff-5c6d53396b4b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:59.681499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18e883-5b53-42f5-9fff-5c6d53396b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:59.682008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18e883-5b53-42f5-9fff-5c6d53396b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:59.716950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773fb7f-ab6f-4f5c-af1e-fd7b85af5483 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:03:59.756781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:59.767438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484f93c-96bb-4148-866a-01de3c008b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:03:59.773941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484f93c-96bb-4148-866a-01de3c008b94 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:03:59.773941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484f93c-96bb-4148-866a-01de3c008b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:03:59.773941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484f93c-96bb-4148-866a-01de3c008b94 None admin] PATH_INFO: `/v3/users/c02e70d9f4b9452a9217f7dc0dcb5387` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:03:59.773941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484f93c-96bb-4148-866a-01de3c008b94 None admin] RBAC: Authorizing `identity:get_user(user_id=c02e70d9f4b9452a9217f7dc0dcb5387)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:59.773941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484f93c-96bb-4148-866a-01de3c008b94 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:59.774312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:03:59.774383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 124/248] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:03:59 2022] GET /identity/v3/users/c02e70d9f4b9452a9217f7dc0dcb5387 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:03:59.776635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18e883-5b53-42f5-9fff-5c6d53396b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:03:59.778466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18e883-5b53-42f5-9fff-5c6d53396b4b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:03:59.779445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484f93c-96bb-4148-866a-01de3c008b94 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:59.891241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 125/249] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 03:03:59.898504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18e883-5b53-42f5-9fff-5c6d53396b4b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:03:59.952742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484f93c-96bb-4148-866a-01de3c008b94 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:00.030160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18e883-5b53-42f5-9fff-5c6d53396b4b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:00.040681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:00.048402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83253ee7-ec58-4f2e-85ec-26a813bfd225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:00.049414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253ee7-ec58-4f2e-85ec-26a813bfd225 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.049866 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253ee7-ec58-4f2e-85ec-26a813bfd225 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.050243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253ee7-ec58-4f2e-85ec-26a813bfd225 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.051536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83253ee7-ec58-4f2e-85ec-26a813bfd225 None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:00.053142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83253ee7-ec58-4f2e-85ec-26a813bfd225 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:00.059689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 125/250] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:59 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:00.061234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4869e1-d3ae-43fd-80f7-4a2b17c1eff9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.061627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4869e1-d3ae-43fd-80f7-4a2b17c1eff9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.062009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4869e1-d3ae-43fd-80f7-4a2b17c1eff9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.067387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 126/251] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:00.068347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4869e1-d3ae-43fd-80f7-4a2b17c1eff9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:00.075764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fd9d6-18df-4716-9cad-d847aa030f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:00.076913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fd9d6-18df-4716-9cad-d847aa030f49 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.078261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fd9d6-18df-4716-9cad-d847aa030f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.080501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fd9d6-18df-4716-9cad-d847aa030f49 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.083703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fd9d6-18df-4716-9cad-d847aa030f49 None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:00.085356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fd9d6-18df-4716-9cad-d847aa030f49 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:00.093205 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 126/252] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:03:59 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:00.094729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92259a36-ffd0-4f04-a3fc-9a53f1f25f14 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.095183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92259a36-ffd0-4f04-a3fc-9a53f1f25f14 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.096275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92259a36-ffd0-4f04-a3fc-9a53f1f25f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.132519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-92259a36-ffd0-4f04-a3fc-9a53f1f25f14 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:00.135955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-92259a36-ffd0-4f04-a3fc-9a53f1f25f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:00.224578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:00.264989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 127/253] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:00.267234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92259a36-ffd0-4f04-a3fc-9a53f1f25f14 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:00.297408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4869e1-d3ae-43fd-80f7-4a2b17c1eff9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:00.345305 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb069145-df8e-4786-9595-0e1ff474e7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:00.346093 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb069145-df8e-4786-9595-0e1ff474e7af None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.346378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb069145-df8e-4786-9595-0e1ff474e7af None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.346651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb069145-df8e-4786-9595-0e1ff474e7af None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536/users/c02e70d9f4b9452a9217f7dc0dcb5387/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.348796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb069145-df8e-4786-9595-0e1ff474e7af None admin] RBAC: Authorizing `identity:create_grant(project_id=6da20a2c16864901ae4e4966a4f38536, user_id=c02e70d9f4b9452a9217f7dc0dcb5387, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:00.350414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb069145-df8e-4786-9595-0e1ff474e7af None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:00.393139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:00.396886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92259a36-ffd0-4f04-a3fc-9a53f1f25f14 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:00.431703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf6ca-2485-4f39-b6a5-d90975f03417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:00.432489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf6ca-2485-4f39-b6a5-d90975f03417 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.432813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf6ca-2485-4f39-b6a5-d90975f03417 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.433098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf6ca-2485-4f39-b6a5-d90975f03417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.434297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbf6ca-2485-4f39-b6a5-d90975f03417 None admin] RBAC: Adding query filter params (role.id=c398a9e080af4ba68f03ea9f28debb38, scope.project.id=6da20a2c16864901ae4e4966a4f38536, user.id=9f50500720e54e8b8166b5b9e67a2085) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:00.434669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbf6ca-2485-4f39-b6a5-d90975f03417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:00.436508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbf6ca-2485-4f39-b6a5-d90975f03417 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:00.444924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 127/254] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:04:00 2022] PUT /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536/users/c02e70d9f4b9452a9217f7dc0dcb5387/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:00.444924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb069145-df8e-4786-9595-0e1ff474e7af None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:00.453155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 128/255] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:00 2022] GET /identity/v3/role_assignments?user.id=9f50500720e54e8b8166b5b9e67a2085&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=c398a9e080af4ba68f03ea9f28debb38 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:00.455206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d579943-90c2-4a19-90b0-77dc255090cf None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.455499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d579943-90c2-4a19-90b0-77dc255090cf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.455783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d579943-90c2-4a19-90b0-77dc255090cf None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.459706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 129/256] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:00.467672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd96f1-262f-4227-8c44-4e35b7203ebe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.468011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd96f1-262f-4227-8c44-4e35b7203ebe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.468266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd96f1-262f-4227-8c44-4e35b7203ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.506029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b0cd96f1-262f-4227-8c44-4e35b7203ebe None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:00.510226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b0cd96f1-262f-4227-8c44-4e35b7203ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:00.615996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 130/257] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:00.641664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd96f1-262f-4227-8c44-4e35b7203ebe None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:00.651325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb069145-df8e-4786-9595-0e1ff474e7af None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:00.696701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:00.709420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fca12-57ba-4c89-b1ea-a1498fb9db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:00.710309 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fca12-57ba-4c89-b1ea-a1498fb9db66 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.710597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fca12-57ba-4c89-b1ea-a1498fb9db66 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.712179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fca12-57ba-4c89-b1ea-a1498fb9db66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.731171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fca12-57ba-4c89-b1ea-a1498fb9db66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-582fca12-57ba-4c89-b1ea-a1498fb9db66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:00.739391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:00.740403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:00.741627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 128/258] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:00.746550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fca12-57ba-4c89-b1ea-a1498fb9db66 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:00.802324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:00.813491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd96f1-262f-4227-8c44-4e35b7203ebe None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:00.854716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8693c82-ed73-453f-b830-8723771a95d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:00.855855 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8693c82-ed73-453f-b830-8723771a95d4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.856558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8693c82-ed73-453f-b830-8723771a95d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.857156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8693c82-ed73-453f-b830-8723771a95d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.868899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8693c82-ed73-453f-b830-8723771a95d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e8693c82-ed73-453f-b830-8723771a95d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:00.878947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:00.880077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:00.880900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:00.885191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 131/259] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:04:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:00.889759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8693c82-ed73-453f-b830-8723771a95d4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:00.897083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fca12-57ba-4c89-b1ea-a1498fb9db66 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:00.935737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91a5b-ea10-44d2-a324-d649ebe4fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:00.937118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91a5b-ea10-44d2-a324-d649ebe4fd8e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:00.937319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91a5b-ea10-44d2-a324-d649ebe4fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:00.937574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d91a5b-ea10-44d2-a324-d649ebe4fd8e None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:00.938331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d91a5b-ea10-44d2-a324-d649ebe4fd8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:00.939370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d91a5b-ea10-44d2-a324-d649ebe4fd8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:00.940222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d91a5b-ea10-44d2-a324-d649ebe4fd8e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:00.949445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 129/260] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:00.955484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91a5b-ea10-44d2-a324-d649ebe4fd8e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:01.019880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8693c82-ed73-453f-b830-8723771a95d4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:01.060682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efe96c-e998-496a-943a-f0eca9d94158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:01.062551 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efe96c-e998-496a-943a-f0eca9d94158 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:01.063050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efe96c-e998-496a-943a-f0eca9d94158 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:01.063524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efe96c-e998-496a-943a-f0eca9d94158 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:01.064493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efe96c-e998-496a-943a-f0eca9d94158 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:01.065636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:01.065866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efe96c-e998-496a-943a-f0eca9d94158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:01.067496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efe96c-e998-496a-943a-f0eca9d94158 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:01.078652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 132/261] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:01.085814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efe96c-e998-496a-943a-f0eca9d94158 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:01.122060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:01.174087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d91a5b-ea10-44d2-a324-d649ebe4fd8e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:01.251494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efe96c-e998-496a-943a-f0eca9d94158 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:01.289051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8779d7-087e-4558-a7d5-a5876fadc00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:01.290291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8779d7-087e-4558-a7d5-a5876fadc00a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:01.290755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8779d7-087e-4558-a7d5-a5876fadc00a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:01.291203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8779d7-087e-4558-a7d5-a5876fadc00a None admin] PATH_INFO: `/v3/users/0ab4e0f30444423dbe587709d78ebb2a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:01.292616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8779d7-087e-4558-a7d5-a5876fadc00a None admin] RBAC: Authorizing `identity:get_user(user_id=0ab4e0f30444423dbe587709d78ebb2a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:01.293020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6023-99e2-4240-80c5-b3a4e493ea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:01.293903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6023-99e2-4240-80c5-b3a4e493ea14 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:01.294183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6023-99e2-4240-80c5-b3a4e493ea14 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:01.294455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6023-99e2-4240-80c5-b3a4e493ea14 None admin] PATH_INFO: `/v3/users/0ab4e0f30444423dbe587709d78ebb2a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:01.295834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8779d7-087e-4558-a7d5-a5876fadc00a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:01.296215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a6023-99e2-4240-80c5-b3a4e493ea14 None admin] RBAC: Authorizing `identity:get_user(user_id=0ab4e0f30444423dbe587709d78ebb2a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:01.297716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a6023-99e2-4240-80c5-b3a4e493ea14 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:01.302585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 130/263] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:00 2022] GET /identity/v3/users/0ab4e0f30444423dbe587709d78ebb2a => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:01.302826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 133/263] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:01 2022] GET /identity/v3/users/0ab4e0f30444423dbe587709d78ebb2a => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:01.305092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6023-99e2-4240-80c5-b3a4e493ea14 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:01.305332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8779d7-087e-4558-a7d5-a5876fadc00a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:01.487015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:01.516620 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8779d7-087e-4558-a7d5-a5876fadc00a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:01.518517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6023-99e2-4240-80c5-b3a4e493ea14 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:01.573208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b611-2340-4056-abc1-17ac22b9f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:01.574201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b611-2340-4056-abc1-17ac22b9f596 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:01.574673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:01.574781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b611-2340-4056-abc1-17ac22b9f596 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:01.575219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b611-2340-4056-abc1-17ac22b9f596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:01.661059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb5174-e956-49d6-af82-0990aaae0188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:01.661759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb5174-e956-49d6-af82-0990aaae0188 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:01.662048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb5174-e956-49d6-af82-0990aaae0188 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:01.662259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb5174-e956-49d6-af82-0990aaae0188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:01.688800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04b611-2340-4056-abc1-17ac22b9f596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:01.690438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04b611-2340-4056-abc1-17ac22b9f596 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:01.738462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb5174-e956-49d6-af82-0990aaae0188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:01.739848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb5174-e956-49d6-af82-0990aaae0188 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:01.844059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 131/264] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:01.850064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb5174-e956-49d6-af82-0990aaae0188 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:01.877838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:01.929468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:01.983252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 134/265] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:01.990377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b611-2340-4056-abc1-17ac22b9f596 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:01.991019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb5174-e956-49d6-af82-0990aaae0188 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:02.042830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33197a20-cab4-4a5f-9d92-0a224d11cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:02.043701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197a20-cab4-4a5f-9d92-0a224d11cd6e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:02.043979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197a20-cab4-4a5f-9d92-0a224d11cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:02.044257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197a20-cab4-4a5f-9d92-0a224d11cd6e None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:02.049024 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33197a20-cab4-4a5f-9d92-0a224d11cd6e None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:02.050504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33197a20-cab4-4a5f-9d92-0a224d11cd6e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:02.052546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 132/266] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:01 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:02.058552 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33197a20-cab4-4a5f-9d92-0a224d11cd6e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:02.200335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:02.216174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33197a20-cab4-4a5f-9d92-0a224d11cd6e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:02.239561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b611-2340-4056-abc1-17ac22b9f596 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:02.260760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1e21-345d-4808-b10d-4a779367e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:02.261431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1e21-345d-4808-b10d-4a779367e577 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:02.261710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1e21-345d-4808-b10d-4a779367e577 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:02.261982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1e21-345d-4808-b10d-4a779367e577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:02.262830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1e21-345d-4808-b10d-4a779367e577 None admin] RBAC: Adding query filter params (role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=6da20a2c16864901ae4e4966a4f38536, user.id=0ab4e0f30444423dbe587709d78ebb2a) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:02.263142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1e21-345d-4808-b10d-4a779367e577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:02.265266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1e21-345d-4808-b10d-4a779367e577 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:02.284564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 133/267] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:02 2022] GET /identity/v3/role_assignments?user.id=0ab4e0f30444423dbe587709d78ebb2a&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:02.314488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581b21b-e303-453f-8927-7d3062f2626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:02.315386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581b21b-e303-453f-8927-7d3062f2626c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:02.315668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581b21b-e303-453f-8927-7d3062f2626c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:02.315946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581b21b-e303-453f-8927-7d3062f2626c None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:02.319406 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581b21b-e303-453f-8927-7d3062f2626c None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:02.320917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581b21b-e303-453f-8927-7d3062f2626c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:02.323166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 135/268] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:01 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:02.329627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1e21-345d-4808-b10d-4a779367e577 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:02.386867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6a94-9d32-4165-b302-9bf50b0b230a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:02.387211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6a94-9d32-4165-b302-9bf50b0b230a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:02.387424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6a94-9d32-4165-b302-9bf50b0b230a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:02.389624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 136/269] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:04:02.398324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e3cb-5120-47cb-8ac1-998f7e82d3fe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:02.398983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e3cb-5120-47cb-8ac1-998f7e82d3fe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:02.399464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e3cb-5120-47cb-8ac1-998f7e82d3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:02.429799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-63c1e3cb-5120-47cb-8ac1-998f7e82d3fe None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:02.431377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-63c1e3cb-5120-47cb-8ac1-998f7e82d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:02.463301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1e21-345d-4808-b10d-4a779367e577 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:02.511616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:02.519488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baef8f-2721-48ed-b3c6-bd018fdf6d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:02.520171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baef8f-2721-48ed-b3c6-bd018fdf6d63 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:02.520502 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baef8f-2721-48ed-b3c6-bd018fdf6d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:02.520785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baef8f-2721-48ed-b3c6-bd018fdf6d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:02.521913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baef8f-2721-48ed-b3c6-bd018fdf6d63 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=6da20a2c16864901ae4e4966a4f38536, user.id=0ab4e0f30444423dbe587709d78ebb2a) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:02.522034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baef8f-2721-48ed-b3c6-bd018fdf6d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:02.523555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baef8f-2721-48ed-b3c6-bd018fdf6d63 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:02.536012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 134/270] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:02 2022] GET /identity/v3/role_assignments?user.id=0ab4e0f30444423dbe587709d78ebb2a&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:02.536798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 137/271] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 26 03:04:02.579864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baef8f-2721-48ed-b3c6-bd018fdf6d63 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:02.602511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:02.708285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baef8f-2721-48ed-b3c6-bd018fdf6d63 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:02.755969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1530387-4f44-4932-ac1c-27079b4b51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:02.756807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1530387-4f44-4932-ac1c-27079b4b51b3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:02.757089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1530387-4f44-4932-ac1c-27079b4b51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:02.757365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1530387-4f44-4932-ac1c-27079b4b51b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:02.774351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1530387-4f44-4932-ac1c-27079b4b51b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e1530387-4f44-4932-ac1c-27079b4b51b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:02.782101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:02.783212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:02.784113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 135/272] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:02.801889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e3cb-5120-47cb-8ac1-998f7e82d3fe None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:02.934127 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e3cb-5120-47cb-8ac1-998f7e82d3fe None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:02.975328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955fc8b-52bb-47a8-b718-3f550e2eb936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:02.976009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955fc8b-52bb-47a8-b718-3f550e2eb936 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:02.976294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955fc8b-52bb-47a8-b718-3f550e2eb936 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:02.976601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955fc8b-52bb-47a8-b718-3f550e2eb936 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:02.977354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955fc8b-52bb-47a8-b718-3f550e2eb936 None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:02.977662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955fc8b-52bb-47a8-b718-3f550e2eb936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:02.979036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955fc8b-52bb-47a8-b718-3f550e2eb936 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:02.988156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 138/273] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:02.994082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1530387-4f44-4932-ac1c-27079b4b51b3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:03.083437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6b96-aa7c-4267-a2da-96fc1b69e9a3 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.083622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6b96-aa7c-4267-a2da-96fc1b69e9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.083898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6b96-aa7c-4267-a2da-96fc1b69e9a3 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.085604 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 139/274] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:04:03.091100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f2bf-ed22-43cc-9c60-032c4dbab0bf None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.091385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f2bf-ed22-43cc-9c60-032c4dbab0bf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.091661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f2bf-ed22-43cc-9c60-032c4dbab0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.108680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:03.120484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c766f2bf-ed22-43cc-9c60-032c4dbab0bf None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:03.121658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c766f2bf-ed22-43cc-9c60-032c4dbab0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:03.138121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1530387-4f44-4932-ac1c-27079b4b51b3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:03.167959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:03.175277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d0065-d83b-439a-9ece-5c4de56ef795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:03.176161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d0065-d83b-439a-9ece-5c4de56ef795 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.176519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d0065-d83b-439a-9ece-5c4de56ef795 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.176803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d0065-d83b-439a-9ece-5c4de56ef795 None admin] PATH_INFO: `/v3/users/9729348101f0465ea10d8735569ea47f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.193247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d0065-d83b-439a-9ece-5c4de56ef795 None admin] RBAC: Authorizing `identity:get_user(user_id=9729348101f0465ea10d8735569ea47f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:03.195703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d0065-d83b-439a-9ece-5c4de56ef795 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:03.198832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 136/275] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:02 2022] GET /identity/v3/users/9729348101f0465ea10d8735569ea47f => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:03.204997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d0065-d83b-439a-9ece-5c4de56ef795 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:03.216634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 140/276] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:03.239638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766f2bf-ed22-43cc-9c60-032c4dbab0bf None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:03.316791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d0065-d83b-439a-9ece-5c4de56ef795 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:03.348781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:03.355098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff2929-6129-4e0f-9c1b-8ef5598917aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:03.355808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff2929-6129-4e0f-9c1b-8ef5598917aa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.356057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff2929-6129-4e0f-9c1b-8ef5598917aa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.356360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff2929-6129-4e0f-9c1b-8ef5598917aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.357337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff2929-6129-4e0f-9c1b-8ef5598917aa None admin] RBAC: Adding query filter params (role.id=64789f5937034a188d1774823d2387cb, user.id=9729348101f0465ea10d8735569ea47f, scope.system=all) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:03.361743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff2929-6129-4e0f-9c1b-8ef5598917aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:03.361743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff2929-6129-4e0f-9c1b-8ef5598917aa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:03.366558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 137/277] 10.222.0.15 () {56 vars in 1308 bytes} [Thu May 26 03:04:03 2022] GET /identity/v3/role_assignments?user.id=9729348101f0465ea10d8735569ea47f&scope.system=all&role.id=64789f5937034a188d1774823d2387cb => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:03.376342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766f2bf-ed22-43cc-9c60-032c4dbab0bf None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:03.412081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e171f-483e-4957-867d-add071740ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:03.412927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e171f-483e-4957-867d-add071740ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.413212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e171f-483e-4957-867d-add071740ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.413488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e171f-483e-4957-867d-add071740ff2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.414696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e171f-483e-4957-867d-add071740ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:03.416166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e171f-483e-4957-867d-add071740ff2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:03.418185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 141/278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:03.424062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff2929-6129-4e0f-9c1b-8ef5598917aa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:03.537930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff2929-6129-4e0f-9c1b-8ef5598917aa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:03.577830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d363165-de31-4301-b6f1-7fe36d40bb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:03.578891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d363165-de31-4301-b6f1-7fe36d40bb87 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.579374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d363165-de31-4301-b6f1-7fe36d40bb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.579846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d363165-de31-4301-b6f1-7fe36d40bb87 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.580803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d363165-de31-4301-b6f1-7fe36d40bb87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:03.582454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d363165-de31-4301-b6f1-7fe36d40bb87 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:03.595152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9afb9-bd4c-4cda-8d0b-163f6bca0ee7 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.595680 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9afb9-bd4c-4cda-8d0b-163f6bca0ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.595680 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9afb9-bd4c-4cda-8d0b-163f6bca0ee7 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.600424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 142/279] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:03.602368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042931b1-74fd-40fa-95c0-572e0829baf3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.602697 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042931b1-74fd-40fa-95c0-572e0829baf3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.602938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042931b1-74fd-40fa-95c0-572e0829baf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.619942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-042931b1-74fd-40fa-95c0-572e0829baf3 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:03.622060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-042931b1-74fd-40fa-95c0-572e0829baf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:03.656686 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:03.674184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 138/280] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:04:03 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:04:03.695235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 143/281] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:03.718536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d363165-de31-4301-b6f1-7fe36d40bb87 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:03.744995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546e37b-81c5-40f0-aa36-067f774fd6c3 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.745329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546e37b-81c5-40f0-aa36-067f774fd6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.745549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546e37b-81c5-40f0-aa36-067f774fd6c3 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.747255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 144/282] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:03.752886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e13d4-2ce0-4a18-af61-8fe8062aca50 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.753177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e13d4-2ce0-4a18-af61-8fe8062aca50 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.753441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e13d4-2ce0-4a18-af61-8fe8062aca50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.771613 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-651e13d4-2ce0-4a18-af61-8fe8062aca50 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:03.772995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-651e13d4-2ce0-4a18-af61-8fe8062aca50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:03.784677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:03.852921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d363165-de31-4301-b6f1-7fe36d40bb87 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:03.858605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 145/283] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:03.887341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e13d4-2ce0-4a18-af61-8fe8062aca50 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:03.909829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b1564-a29f-4c0a-96a5-63d34f4ca2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:03.911036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b1564-a29f-4c0a-96a5-63d34f4ca2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:03.911566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b1564-a29f-4c0a-96a5-63d34f4ca2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:03.912112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b1564-a29f-4c0a-96a5-63d34f4ca2c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:03.923857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b1564-a29f-4c0a-96a5-63d34f4ca2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bf8b1564-a29f-4c0a-96a5-63d34f4ca2c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:03.932044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:03.933019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:03.933853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:03.934465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 139/284] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:03.940597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b1564-a29f-4c0a-96a5-63d34f4ca2c8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:04.006904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e13d4-2ce0-4a18-af61-8fe8062aca50 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:04.011167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:04.046854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609038a5-43bc-4390-a9b1-6562ddc698af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:04.047789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609038a5-43bc-4390-a9b1-6562ddc698af None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:04.048074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609038a5-43bc-4390-a9b1-6562ddc698af None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:04.048397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609038a5-43bc-4390-a9b1-6562ddc698af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:04.062102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609038a5-43bc-4390-a9b1-6562ddc698af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:04.067744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b1564-a29f-4c0a-96a5-63d34f4ca2c8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-609038a5-43bc-4390-a9b1-6562ddc698af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:04.070295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:04.071163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:04.072097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 146/285] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:04.078718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609038a5-43bc-4390-a9b1-6562ddc698af None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:04.081939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:04.109569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a1f4-804e-4075-9d4f-4951a21f3b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:04.110536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a1f4-804e-4075-9d4f-4951a21f3b3c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:04.110824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a1f4-804e-4075-9d4f-4951a21f3b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:04.111105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a1f4-804e-4075-9d4f-4951a21f3b3c None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:04.111869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a1f4-804e-4075-9d4f-4951a21f3b3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:04.112178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a1f4-804e-4075-9d4f-4951a21f3b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:04.113701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a1f4-804e-4075-9d4f-4951a21f3b3c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:04.128144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 140/286] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:04.132880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a1f4-804e-4075-9d4f-4951a21f3b3c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:04.214922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609038a5-43bc-4390-a9b1-6562ddc698af None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:04.250206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553d190-2f02-4dea-8391-fe21b1a6abfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:04.250879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553d190-2f02-4dea-8391-fe21b1a6abfb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:04.251165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553d190-2f02-4dea-8391-fe21b1a6abfb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:04.251452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553d190-2f02-4dea-8391-fe21b1a6abfb None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:04.252173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553d190-2f02-4dea-8391-fe21b1a6abfb None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:04.252512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553d190-2f02-4dea-8391-fe21b1a6abfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:04.253892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553d190-2f02-4dea-8391-fe21b1a6abfb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:04.262631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 147/287] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:04.263633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a1f4-804e-4075-9d4f-4951a21f3b3c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:04.268118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553d190-2f02-4dea-8391-fe21b1a6abfb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:04.295466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:04.305115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7afcfd-a55d-4c5b-9470-5ba26040fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:04.306041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7afcfd-a55d-4c5b-9470-5ba26040fb2c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:04.306322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7afcfd-a55d-4c5b-9470-5ba26040fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:04.306595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7afcfd-a55d-4c5b-9470-5ba26040fb2c None admin] PATH_INFO: `/v3/users/9f50500720e54e8b8166b5b9e67a2085` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:04.310985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7afcfd-a55d-4c5b-9470-5ba26040fb2c None admin] RBAC: Authorizing `identity:get_user(user_id=9f50500720e54e8b8166b5b9e67a2085)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:04.312720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7afcfd-a55d-4c5b-9470-5ba26040fb2c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:04.318595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 141/288] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:04 2022] GET /identity/v3/users/9f50500720e54e8b8166b5b9e67a2085 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:04.325516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7afcfd-a55d-4c5b-9470-5ba26040fb2c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:04.381608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553d190-2f02-4dea-8391-fe21b1a6abfb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:04.397928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:04.421042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3305-241a-40ce-9067-9122d3144a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:04.422297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3305-241a-40ce-9067-9122d3144a6a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:04.423603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3305-241a-40ce-9067-9122d3144a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:04.424082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3305-241a-40ce-9067-9122d3144a6a None admin] PATH_INFO: `/v3/users/c02e70d9f4b9452a9217f7dc0dcb5387` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:04.429160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c3305-241a-40ce-9067-9122d3144a6a None admin] RBAC: Authorizing `identity:get_user(user_id=c02e70d9f4b9452a9217f7dc0dcb5387)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:04.430836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c3305-241a-40ce-9067-9122d3144a6a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:04.433529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 148/289] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:04 2022] GET /identity/v3/users/c02e70d9f4b9452a9217f7dc0dcb5387 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:04.438487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3305-241a-40ce-9067-9122d3144a6a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:04.526038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7afcfd-a55d-4c5b-9470-5ba26040fb2c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:04.584605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2b9b-44dd-445e-a879-422cca9690b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:04.585730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2b9b-44dd-445e-a879-422cca9690b8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:04.586012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2b9b-44dd-445e-a879-422cca9690b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:04.586287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2b9b-44dd-445e-a879-422cca9690b8 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:04.586720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:04.587931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e2b9b-44dd-445e-a879-422cca9690b8 None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:04.589834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e2b9b-44dd-445e-a879-422cca9690b8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:04.591883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 142/290] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:04 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:04.594860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3305-241a-40ce-9067-9122d3144a6a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:04.602341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2b9b-44dd-445e-a879-422cca9690b8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:04.655401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab612d-673e-4831-8329-58d9fe7c1a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:04.656041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab612d-673e-4831-8329-58d9fe7c1a4b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:04.656260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab612d-673e-4831-8329-58d9fe7c1a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:04.656562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab612d-673e-4831-8329-58d9fe7c1a4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:04.727483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab612d-673e-4831-8329-58d9fe7c1a4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:04.728968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab612d-673e-4831-8329-58d9fe7c1a4b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:04.835238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:04.853227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 149/291] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 03:04:04.857084 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2b9b-44dd-445e-a879-422cca9690b8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:04.859965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab612d-673e-4831-8329-58d9fe7c1a4b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:04.877542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:04.920957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e1d34-99fc-4a4d-9fb0-412024da73dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:04.921781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e1d34-99fc-4a4d-9fb0-412024da73dd None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:04.922066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e1d34-99fc-4a4d-9fb0-412024da73dd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:04.922346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e1d34-99fc-4a4d-9fb0-412024da73dd None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536/users/9f50500720e54e8b8166b5b9e67a2085/roles/c398a9e080af4ba68f03ea9f28debb38` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:04.925217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e1d34-99fc-4a4d-9fb0-412024da73dd None admin] RBAC: Authorizing `identity:create_grant(project_id=6da20a2c16864901ae4e4966a4f38536, user_id=9f50500720e54e8b8166b5b9e67a2085, role_id=c398a9e080af4ba68f03ea9f28debb38)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:04.926690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e1d34-99fc-4a4d-9fb0-412024da73dd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:04.997206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab612d-673e-4831-8329-58d9fe7c1a4b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:05.010858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 143/292] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:04:04 2022] PUT /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536/users/9f50500720e54e8b8166b5b9e67a2085/roles/c398a9e080af4ba68f03ea9f28debb38 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:05.049808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f2c5c-1f93-4fea-aeec-312bb841267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:05.050700 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f2c5c-1f93-4fea-aeec-312bb841267f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:05.050976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f2c5c-1f93-4fea-aeec-312bb841267f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:05.051251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f2c5c-1f93-4fea-aeec-312bb841267f None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:05.052538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f2c5c-1f93-4fea-aeec-312bb841267f None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:05.054092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f2c5c-1f93-4fea-aeec-312bb841267f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:05.056101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 150/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:04 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:05.062264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e1d34-99fc-4a4d-9fb0-412024da73dd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:05.182090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e1d34-99fc-4a4d-9fb0-412024da73dd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:05.223224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6d42b-effb-4ff0-90b2-cb1ea48a8b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:05.224237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6d42b-effb-4ff0-90b2-cb1ea48a8b7f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:05.224726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6d42b-effb-4ff0-90b2-cb1ea48a8b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:05.225177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6d42b-effb-4ff0-90b2-cb1ea48a8b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:05.226200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6d42b-effb-4ff0-90b2-cb1ea48a8b7f None admin] RBAC: Adding query filter params (role.id=64789f5937034a188d1774823d2387cb, scope.project.id=6da20a2c16864901ae4e4966a4f38536, user.id=c02e70d9f4b9452a9217f7dc0dcb5387) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:05.226709 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6d42b-effb-4ff0-90b2-cb1ea48a8b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:05.228399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6d42b-effb-4ff0-90b2-cb1ea48a8b7f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:05.236396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 144/294] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:05 2022] GET /identity/v3/role_assignments?user.id=c02e70d9f4b9452a9217f7dc0dcb5387&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=64789f5937034a188d1774823d2387cb => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:05.860476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d68795-1ac2-4ed4-a243-bc726b294fc9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:05.860985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d68795-1ac2-4ed4-a243-bc726b294fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:05.861059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d68795-1ac2-4ed4-a243-bc726b294fc9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:05.862634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 151/295] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:05.867938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474340e-0266-44ec-a668-ee0185eaeb4f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:05.868349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474340e-0266-44ec-a668-ee0185eaeb4f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:05.868542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474340e-0266-44ec-a668-ee0185eaeb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:05.886292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0474340e-0266-44ec-a668-ee0185eaeb4f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:05.887468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0474340e-0266-44ec-a668-ee0185eaeb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:05.916148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:05.964426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 145/296] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:05.984642 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d68795-1ac2-4ed4-a243-bc726b294fc9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:06.046766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:06.090049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d68795-1ac2-4ed4-a243-bc726b294fc9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:06.124520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c7c89-65d1-46de-8c30-1384ddbd4b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:06.125318 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c7c89-65d1-46de-8c30-1384ddbd4b12 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.125669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c7c89-65d1-46de-8c30-1384ddbd4b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.125944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c7c89-65d1-46de-8c30-1384ddbd4b12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.136185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c7c89-65d1-46de-8c30-1384ddbd4b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-477c7c89-65d1-46de-8c30-1384ddbd4b12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:06.143982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:06.144889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:06.145685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:06.150062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 152/297] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:06.151508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474340e-0266-44ec-a668-ee0185eaeb4f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:06.258716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474340e-0266-44ec-a668-ee0185eaeb4f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:06.295044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e64b3-a4ce-4b7a-84da-7d7ef7ab6e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:06.295712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e64b3-a4ce-4b7a-84da-7d7ef7ab6e2c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.295994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e64b3-a4ce-4b7a-84da-7d7ef7ab6e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.296264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e64b3-a4ce-4b7a-84da-7d7ef7ab6e2c None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.297035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e64b3-a4ce-4b7a-84da-7d7ef7ab6e2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:06.297341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e64b3-a4ce-4b7a-84da-7d7ef7ab6e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:06.298724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e64b3-a4ce-4b7a-84da-7d7ef7ab6e2c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:06.311698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 146/298] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:06.313055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c7c89-65d1-46de-8c30-1384ddbd4b12 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:06.349542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3029d-d01b-476d-b396-05718d9188cd None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.349801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3029d-d01b-476d-b396-05718d9188cd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.350011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3029d-d01b-476d-b396-05718d9188cd None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.351411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 147/299] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:06.358372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a5bd4-bf10-4e59-b3d7-c257623469fc None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.358657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a5bd4-bf10-4e59-b3d7-c257623469fc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.358932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a5bd4-bf10-4e59-b3d7-c257623469fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.379675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4e0a5bd4-bf10-4e59-b3d7-c257623469fc None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:06.381322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4e0a5bd4-bf10-4e59-b3d7-c257623469fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:06.405873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:06.436912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c7c89-65d1-46de-8c30-1384ddbd4b12 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:06.455494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:06.461861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 148/300] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:06.476067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769fe49-c3d4-4ba4-b814-a5dd43ac95ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:06.477034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769fe49-c3d4-4ba4-b814-a5dd43ac95ac None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.477315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769fe49-c3d4-4ba4-b814-a5dd43ac95ac None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.477588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769fe49-c3d4-4ba4-b814-a5dd43ac95ac None admin] PATH_INFO: `/v3/users/9729348101f0465ea10d8735569ea47f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.478825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769fe49-c3d4-4ba4-b814-a5dd43ac95ac None admin] RBAC: Authorizing `identity:get_user(user_id=9729348101f0465ea10d8735569ea47f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:06.480251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769fe49-c3d4-4ba4-b814-a5dd43ac95ac None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:06.482169 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 153/301] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:06 2022] GET /identity/v3/users/9729348101f0465ea10d8735569ea47f => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:06.488487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769fe49-c3d4-4ba4-b814-a5dd43ac95ac None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:06.488873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a5bd4-bf10-4e59-b3d7-c257623469fc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:06.593561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a5bd4-bf10-4e59-b3d7-c257623469fc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:06.596386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769fe49-c3d4-4ba4-b814-a5dd43ac95ac None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:06.628118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd08ac-b015-4853-95d9-f60573569cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:06.628893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd08ac-b015-4853-95d9-f60573569cfd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.629131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd08ac-b015-4853-95d9-f60573569cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.629405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd08ac-b015-4853-95d9-f60573569cfd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.631181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c6821-9b4a-4419-8f7c-89e531cee9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:06.632050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c6821-9b4a-4419-8f7c-89e531cee9f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.632379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c6821-9b4a-4419-8f7c-89e531cee9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.632662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c6821-9b4a-4419-8f7c-89e531cee9f9 None admin] PATH_INFO: `/v3/system/users/9729348101f0465ea10d8735569ea47f/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.634204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c6821-9b4a-4419-8f7c-89e531cee9f9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9729348101f0465ea10d8735569ea47f, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:06.635502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c6821-9b4a-4419-8f7c-89e531cee9f9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:06.640543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd08ac-b015-4853-95d9-f60573569cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-66dd08ac-b015-4853-95d9-f60573569cfd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:06.648142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:06.650819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 149/302] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:06.651624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ed75-2607-41f8-9872-8e887c01fbeb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.657041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ed75-2607-41f8-9872-8e887c01fbeb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.657041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ed75-2607-41f8-9872-8e887c01fbeb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.657041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 150/303] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:06.657041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ed75-2607-41f8-9872-8e887c01fbeb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:06.673565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:06.732584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 154/304] 10.222.0.15 () {58 vars in 1334 bytes} [Thu May 26 03:04:06 2022] PUT /identity/v3/system/users/9729348101f0465ea10d8735569ea47f/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:06.732584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58630-e97d-4bb1-b57f-f42757645c1c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.732584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58630-e97d-4bb1-b57f-f42757645c1c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.732584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58630-e97d-4bb1-b57f-f42757645c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.766883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ed75-2607-41f8-9872-8e887c01fbeb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:06.768240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-fdb58630-e97d-4bb1-b57f-f42757645c1c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:06.772663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fdb58630-e97d-4bb1-b57f-f42757645c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:06.828337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a8df-7163-4783-b563-6992fe221b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:06.828337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a8df-7163-4783-b563-6992fe221b62 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:06.828337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a8df-7163-4783-b563-6992fe221b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:06.828337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a8df-7163-4783-b563-6992fe221b62 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:06.828771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4a8df-7163-4783-b563-6992fe221b62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:06.828771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4a8df-7163-4783-b563-6992fe221b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:06.828771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4a8df-7163-4783-b563-6992fe221b62 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:06.837647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:06.845763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 151/305] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:06.849851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a8df-7163-4783-b563-6992fe221b62 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:06.861722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 155/306] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:06.885652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb58630-e97d-4bb1-b57f-f42757645c1c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:07.010864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb58630-e97d-4bb1-b57f-f42757645c1c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:07.018391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:07.062954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4bff2-852f-46b1-85dd-129d12b918fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:07.064438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4bff2-852f-46b1-85dd-129d12b918fa None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:07.064547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a8df-7163-4783-b563-6992fe221b62 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:07.065036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4bff2-852f-46b1-85dd-129d12b918fa None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:07.065524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4bff2-852f-46b1-85dd-129d12b918fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:07.069023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4bff2-852f-46b1-85dd-129d12b918fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:07.070798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4bff2-852f-46b1-85dd-129d12b918fa None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:07.073555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 156/307] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:07.079201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4bff2-852f-46b1-85dd-129d12b918fa None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:07.131035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835f3f1-ac0f-4f3b-b18a-490dd7de188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:07.133734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835f3f1-ac0f-4f3b-b18a-490dd7de188a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:07.134020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835f3f1-ac0f-4f3b-b18a-490dd7de188a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:07.134297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835f3f1-ac0f-4f3b-b18a-490dd7de188a None admin] PATH_INFO: `/v3/users/3b3f3ef575b04fd397fa8788ef48479e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:07.140877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:07.171264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835f3f1-ac0f-4f3b-b18a-490dd7de188a None admin] RBAC: Authorizing `identity:get_user(user_id=3b3f3ef575b04fd397fa8788ef48479e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:07.172549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835f3f1-ac0f-4f3b-b18a-490dd7de188a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:07.181454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 152/308] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:06 2022] GET /identity/v3/users/3b3f3ef575b04fd397fa8788ef48479e => generated 293 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:07.186639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835f3f1-ac0f-4f3b-b18a-490dd7de188a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:07.201575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4bff2-852f-46b1-85dd-129d12b918fa None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:07.243079 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588d97f-84c5-4552-996a-6c4b0526c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:07.244212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588d97f-84c5-4552-996a-6c4b0526c3f4 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:07.244782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588d97f-84c5-4552-996a-6c4b0526c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:07.245363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588d97f-84c5-4552-996a-6c4b0526c3f4 None admin] PATH_INFO: `/v3/groups` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:07.246501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588d97f-84c5-4552-996a-6c4b0526c3f4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:07.249287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588d97f-84c5-4552-996a-6c4b0526c3f4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:07.321679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 157/309] 10.222.0.15 () {60 vars in 1134 bytes} [Thu May 26 03:04:07 2022] POST /identity/v3/groups => generated 229 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:04:07.346934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835f3f1-ac0f-4f3b-b18a-490dd7de188a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:07.389928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b83cd9-8d4f-475b-a8e3-e9bc7d6e5464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:07.390653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b83cd9-8d4f-475b-a8e3-e9bc7d6e5464 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:07.390996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b83cd9-8d4f-475b-a8e3-e9bc7d6e5464 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:07.391212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b83cd9-8d4f-475b-a8e3-e9bc7d6e5464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:07.392188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b83cd9-8d4f-475b-a8e3-e9bc7d6e5464 None admin] RBAC: Adding query filter params (role.id=c398a9e080af4ba68f03ea9f28debb38, user.id=3b3f3ef575b04fd397fa8788ef48479e, scope.system=all) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:07.392536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b83cd9-8d4f-475b-a8e3-e9bc7d6e5464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:07.394231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b83cd9-8d4f-475b-a8e3-e9bc7d6e5464 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:07.397412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:07.401768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 153/310] 10.222.0.15 () {56 vars in 1308 bytes} [Thu May 26 03:04:07 2022] GET /identity/v3/role_assignments?user.id=3b3f3ef575b04fd397fa8788ef48479e&scope.system=all&role.id=c398a9e080af4ba68f03ea9f28debb38 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:07.573559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c100361-9aeb-44a6-b626-faa589c34ada None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:07.573913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c100361-9aeb-44a6-b626-faa589c34ada None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:07.574226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c100361-9aeb-44a6-b626-faa589c34ada None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:07.575816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 158/311] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:07.581794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3069-2475-415c-a61f-81d60fd19f0b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:07.582092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3069-2475-415c-a61f-81d60fd19f0b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:07.582352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3069-2475-415c-a61f-81d60fd19f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:07.600450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c9ca3069-2475-415c-a61f-81d60fd19f0b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:07.601663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c9ca3069-2475-415c-a61f-81d60fd19f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:07.672379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 154/312] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:07.695551 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c100361-9aeb-44a6-b626-faa589c34ada None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:07.805839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c100361-9aeb-44a6-b626-faa589c34ada None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:07.816100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:07.841610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13a223-d5cf-456e-8676-b92727def179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:07.842459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13a223-d5cf-456e-8676-b92727def179 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:07.842746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13a223-d5cf-456e-8676-b92727def179 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:07.843031 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13a223-d5cf-456e-8676-b92727def179 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:07.854005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13a223-d5cf-456e-8676-b92727def179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-cf13a223-d5cf-456e-8676-b92727def179 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:07.863505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:07.867485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:07.868266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 159/313] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:07.872877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca3069-2475-415c-a61f-81d60fd19f0b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:07.979242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca3069-2475-415c-a61f-81d60fd19f0b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:08.009135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:08.014994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca840c-b54f-413e-8cdd-552f8a1c93ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:08.015663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca840c-b54f-413e-8cdd-552f8a1c93ea None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:08.015945 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca840c-b54f-413e-8cdd-552f8a1c93ea None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:08.016219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca840c-b54f-413e-8cdd-552f8a1c93ea None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:08.016997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca840c-b54f-413e-8cdd-552f8a1c93ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:08.017340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca840c-b54f-413e-8cdd-552f8a1c93ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:08.018689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca840c-b54f-413e-8cdd-552f8a1c93ea None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:08.027447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 155/314] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:08.033034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13a223-d5cf-456e-8676-b92727def179 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:08.143360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13a223-d5cf-456e-8676-b92727def179 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:08.179962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461955f-8beb-4283-a2a6-a63a6339d70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:08.181294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461955f-8beb-4283-a2a6-a63a6339d70f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:08.181808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461955f-8beb-4283-a2a6-a63a6339d70f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:08.182345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461955f-8beb-4283-a2a6-a63a6339d70f None admin] PATH_INFO: `/v3/users/9f50500720e54e8b8166b5b9e67a2085` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:08.183821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461955f-8beb-4283-a2a6-a63a6339d70f None admin] RBAC: Authorizing `identity:get_user(user_id=9f50500720e54e8b8166b5b9e67a2085)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:08.185581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461955f-8beb-4283-a2a6-a63a6339d70f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:08.187709 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 160/315] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:08 2022] GET /identity/v3/users/9f50500720e54e8b8166b5b9e67a2085 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:08.193372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca840c-b54f-413e-8cdd-552f8a1c93ea None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:08.297849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca840c-b54f-413e-8cdd-552f8a1c93ea None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:08.331473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea00a8b-7369-4767-843d-0aae9b2c298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:08.332409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea00a8b-7369-4767-843d-0aae9b2c298b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:08.332899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea00a8b-7369-4767-843d-0aae9b2c298b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:08.333402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea00a8b-7369-4767-843d-0aae9b2c298b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:08.400948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:08.407308 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea00a8b-7369-4767-843d-0aae9b2c298b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:08.408930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea00a8b-7369-4767-843d-0aae9b2c298b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:08.511560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 156/316] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:08.517715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461955f-8beb-4283-a2a6-a63a6339d70f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:08.555736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:08.628061 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461955f-8beb-4283-a2a6-a63a6339d70f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:08.664338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f2c96-ac1b-484b-8842-90bc0f9aab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:08.665215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f2c96-ac1b-484b-8842-90bc0f9aab64 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:08.665498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f2c96-ac1b-484b-8842-90bc0f9aab64 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:08.665777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f2c96-ac1b-484b-8842-90bc0f9aab64 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:08.666958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f2c96-ac1b-484b-8842-90bc0f9aab64 None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:08.668429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f2c96-ac1b-484b-8842-90bc0f9aab64 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:08.670503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 161/317] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:08 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:08.676289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea00a8b-7369-4767-843d-0aae9b2c298b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:08.769346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:08.777947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea00a8b-7369-4767-843d-0aae9b2c298b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:08.812894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eebfc7-cdb2-4f13-9940-74dbadd85c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:08.813494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebfc7-cdb2-4f13-9940-74dbadd85c85 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:08.813783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebfc7-cdb2-4f13-9940-74dbadd85c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:08.814301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebfc7-cdb2-4f13-9940-74dbadd85c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:08.815503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eebfc7-cdb2-4f13-9940-74dbadd85c85 None admin] RBAC: Adding query filter params (role.id=c398a9e080af4ba68f03ea9f28debb38, scope.project.id=6da20a2c16864901ae4e4966a4f38536, user.id=9f50500720e54e8b8166b5b9e67a2085) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:08.815820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eebfc7-cdb2-4f13-9940-74dbadd85c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:08.817307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eebfc7-cdb2-4f13-9940-74dbadd85c85 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:08.823326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 157/318] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:08 2022] GET /identity/v3/role_assignments?user.id=9f50500720e54e8b8166b5b9e67a2085&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=c398a9e080af4ba68f03ea9f28debb38 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:09.065566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb352c-a142-4960-bb60-2e40e1b99735 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.066041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb352c-a142-4960-bb60-2e40e1b99735 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.066041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb352c-a142-4960-bb60-2e40e1b99735 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.067675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 162/319] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:09.073185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdbcb4-9092-4e44-a302-cb3bec4b188e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.073619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdbcb4-9092-4e44-a302-cb3bec4b188e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.073811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdbcb4-9092-4e44-a302-cb3bec4b188e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.093834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-02fdbcb4-9092-4e44-a302-cb3bec4b188e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:09.095033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-02fdbcb4-9092-4e44-a302-cb3bec4b188e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:09.163244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 158/320] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:09.186875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb352c-a142-4960-bb60-2e40e1b99735 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:09.290368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb352c-a142-4960-bb60-2e40e1b99735 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:09.292768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:09.325354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9d28-14c5-453e-b0a0-9f6f1c8698c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:09.326603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9d28-14c5-453e-b0a0-9f6f1c8698c9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.326890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9d28-14c5-453e-b0a0-9f6f1c8698c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.327166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9d28-14c5-453e-b0a0-9f6f1c8698c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.338078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f9d28-14c5-453e-b0a0-9f6f1c8698c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-866f9d28-14c5-453e-b0a0-9f6f1c8698c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:09.346729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:09.347624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:09.348812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:09.352466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 163/321] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:09.353802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdbcb4-9092-4e44-a302-cb3bec4b188e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:09.437387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:09.454886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdbcb4-9092-4e44-a302-cb3bec4b188e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:09.492083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056baa72-a47f-476a-928d-a1abc73f3c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:09.492787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056baa72-a47f-476a-928d-a1abc73f3c8f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.493074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056baa72-a47f-476a-928d-a1abc73f3c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.493351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056baa72-a47f-476a-928d-a1abc73f3c8f None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.494098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056baa72-a47f-476a-928d-a1abc73f3c8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:09.494408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056baa72-a47f-476a-928d-a1abc73f3c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:09.495801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056baa72-a47f-476a-928d-a1abc73f3c8f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:09.508433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 159/322] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:09.510374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9d28-14c5-453e-b0a0-9f6f1c8698c9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:09.614348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9d28-14c5-453e-b0a0-9f6f1c8698c9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:09.639299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d910099-eb97-45b2-8abf-33c0f1be8f86 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.639624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d910099-eb97-45b2-8abf-33c0f1be8f86 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.639852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d910099-eb97-45b2-8abf-33c0f1be8f86 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.641379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 160/323] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:09.645997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edc577-089f-4901-9de0-03b619c0c409 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.646296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edc577-089f-4901-9de0-03b619c0c409 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.646570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edc577-089f-4901-9de0-03b619c0c409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.648995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe0891-4eee-4637-831f-a911182eb4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:09.649973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe0891-4eee-4637-831f-a911182eb4dc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.650264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe0891-4eee-4637-831f-a911182eb4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.650541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe0891-4eee-4637-831f-a911182eb4dc None admin] PATH_INFO: `/v3/users/9729348101f0465ea10d8735569ea47f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.651864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe0891-4eee-4637-831f-a911182eb4dc None admin] RBAC: Authorizing `identity:get_user(user_id=9729348101f0465ea10d8735569ea47f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:09.653471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe0891-4eee-4637-831f-a911182eb4dc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:09.660348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 164/324] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:09 2022] GET /identity/v3/users/9729348101f0465ea10d8735569ea47f => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:09.661107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe0891-4eee-4637-831f-a911182eb4dc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:09.663792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e9edc577-089f-4901-9de0-03b619c0c409 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:09.665014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e9edc577-089f-4901-9de0-03b619c0c409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:09.694868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:09.731759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 161/325] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:09.733125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821792-de8d-496e-b2b6-cf4a297f0334 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.733416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821792-de8d-496e-b2b6-cf4a297f0334 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.733692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821792-de8d-496e-b2b6-cf4a297f0334 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.734945 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 162/326] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:09.740217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ff65-5116-4a98-8399-f17eb56ebafe None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.740625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ff65-5116-4a98-8399-f17eb56ebafe None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.740782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624ff65-5116-4a98-8399-f17eb56ebafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.757068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5624ff65-5116-4a98-8399-f17eb56ebafe None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:09.758239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5624ff65-5116-4a98-8399-f17eb56ebafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:09.768487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe0891-4eee-4637-831f-a911182eb4dc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:09.801476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bbb62-b08e-4d9a-af6b-64cd07206324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:09.802130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bbb62-b08e-4d9a-af6b-64cd07206324 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.802422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bbb62-b08e-4d9a-af6b-64cd07206324 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.802689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bbb62-b08e-4d9a-af6b-64cd07206324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.803531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bbb62-b08e-4d9a-af6b-64cd07206324 None admin] RBAC: Adding query filter params (role.id=64789f5937034a188d1774823d2387cb, user.id=9729348101f0465ea10d8735569ea47f, scope.system=all) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:09.803845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bbb62-b08e-4d9a-af6b-64cd07206324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:09.805310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bbb62-b08e-4d9a-af6b-64cd07206324 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:09.817551 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 165/327] 10.222.0.15 () {56 vars in 1308 bytes} [Thu May 26 03:04:09 2022] GET /identity/v3/role_assignments?user.id=9729348101f0465ea10d8735569ea47f&scope.system=all&role.id=64789f5937034a188d1774823d2387cb => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:09.818349 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bbb62-b08e-4d9a-af6b-64cd07206324 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:09.844972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 163/328] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:09.864334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624ff65-5116-4a98-8399-f17eb56ebafe None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:09.876140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:09.922047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:09.932586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bbb62-b08e-4d9a-af6b-64cd07206324 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:09.969550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2697c5b-f1db-4b26-bcd1-1594b995c747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:09.970353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2697c5b-f1db-4b26-bcd1-1594b995c747 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:09.970636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2697c5b-f1db-4b26-bcd1-1594b995c747 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:09.970909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2697c5b-f1db-4b26-bcd1-1594b995c747 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:09.974328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624ff65-5116-4a98-8399-f17eb56ebafe None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:09.982109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2697c5b-f1db-4b26-bcd1-1594b995c747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a2697c5b-f1db-4b26-bcd1-1594b995c747 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:09.990028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:09.991013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:09.991837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 166/329] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:09.997112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2697c5b-f1db-4b26-bcd1-1594b995c747 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:10.020907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171d6a-c5b7-4808-ae99-f83e936f8179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:10.021706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171d6a-c5b7-4808-ae99-f83e936f8179 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:10.021991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171d6a-c5b7-4808-ae99-f83e936f8179 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:10.022268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171d6a-c5b7-4808-ae99-f83e936f8179 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:10.023646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95171d6a-c5b7-4808-ae99-f83e936f8179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:10.025125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95171d6a-c5b7-4808-ae99-f83e936f8179 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:10.026735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 164/330] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:10.032511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171d6a-c5b7-4808-ae99-f83e936f8179 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:10.108585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2697c5b-f1db-4b26-bcd1-1594b995c747 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:10.114594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:10.136789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171d6a-c5b7-4808-ae99-f83e936f8179 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:10.141421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d222cc7-a24a-4448-a9f7-5adf48c4a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:10.142089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d222cc7-a24a-4448-a9f7-5adf48c4a89f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:10.142375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d222cc7-a24a-4448-a9f7-5adf48c4a89f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:10.142651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d222cc7-a24a-4448-a9f7-5adf48c4a89f None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:10.143390 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d222cc7-a24a-4448-a9f7-5adf48c4a89f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:10.143701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d222cc7-a24a-4448-a9f7-5adf48c4a89f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:10.145133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d222cc7-a24a-4448-a9f7-5adf48c4a89f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:10.153522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 167/331] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:10.159042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d222cc7-a24a-4448-a9f7-5adf48c4a89f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:10.170311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215a8b1-3da0-4a94-94e3-573100a8036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:10.170972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a8b1-3da0-4a94-94e3-573100a8036c None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:10.171251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a8b1-3da0-4a94-94e3-573100a8036c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:10.171521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a8b1-3da0-4a94-94e3-573100a8036c None admin] PATH_INFO: `/v3/groups` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:10.172202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215a8b1-3da0-4a94-94e3-573100a8036c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:10.173677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215a8b1-3da0-4a94-94e3-573100a8036c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:10.174068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:10.258071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d222cc7-a24a-4448-a9f7-5adf48c4a89f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:10.266798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 165/332] 10.222.0.15 () {60 vars in 1134 bytes} [Thu May 26 03:04:10 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:04:10.293083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52334554-15b4-455c-a113-952672a3375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:10.293980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52334554-15b4-455c-a113-952672a3375a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:10.294259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52334554-15b4-455c-a113-952672a3375a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:10.294533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52334554-15b4-455c-a113-952672a3375a None admin] PATH_INFO: `/v3/users/3b3f3ef575b04fd397fa8788ef48479e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:10.296330 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52334554-15b4-455c-a113-952672a3375a None admin] RBAC: Authorizing `identity:get_user(user_id=3b3f3ef575b04fd397fa8788ef48479e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:10.297830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52334554-15b4-455c-a113-952672a3375a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:10.299532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 168/333] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:10 2022] GET /identity/v3/users/3b3f3ef575b04fd397fa8788ef48479e => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:10.305530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215a8b1-3da0-4a94-94e3-573100a8036c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:10.409495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215a8b1-3da0-4a94-94e3-573100a8036c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:10.443508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99e32-0fd4-43d3-802e-d6b9c9b2da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:10.444416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99e32-0fd4-43d3-802e-d6b9c9b2da06 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:10.444706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99e32-0fd4-43d3-802e-d6b9c9b2da06 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:10.444990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99e32-0fd4-43d3-802e-d6b9c9b2da06 None admin] PATH_INFO: `/v3/system/users/3b3f3ef575b04fd397fa8788ef48479e/roles/c398a9e080af4ba68f03ea9f28debb38` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:10.446917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae99e32-0fd4-43d3-802e-d6b9c9b2da06 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3b3f3ef575b04fd397fa8788ef48479e, role_id=c398a9e080af4ba68f03ea9f28debb38)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:10.447923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae99e32-0fd4-43d3-802e-d6b9c9b2da06 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:10.451677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:10.531542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 166/334] 10.222.0.15 () {58 vars in 1334 bytes} [Thu May 26 03:04:10 2022] PUT /identity/v3/system/users/3b3f3ef575b04fd397fa8788ef48479e/roles/c398a9e080af4ba68f03ea9f28debb38 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:04:12.709463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155b923-2b4b-4f76-b1ac-5ab08da5baf4 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:12.709981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155b923-2b4b-4f76-b1ac-5ab08da5baf4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:12.710086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155b923-2b4b-4f76-b1ac-5ab08da5baf4 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:12.711692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 169/335] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:12.717787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5e2e-c136-4c7a-b149-d294e4258e66 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:12.718624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5e2e-c136-4c7a-b149-d294e4258e66 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:12.719101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5e2e-c136-4c7a-b149-d294e4258e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:12.742868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2a3f5e2e-c136-4c7a-b149-d294e4258e66 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:12.744440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2a3f5e2e-c136-4c7a-b149-d294e4258e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:12.834918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 167/336] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:12.879381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155b923-2b4b-4f76-b1ac-5ab08da5baf4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:12.996025 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:13.025785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155b923-2b4b-4f76-b1ac-5ab08da5baf4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:13.075503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8733e3-3a99-40a1-b0c3-7008fb1de5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:13.077208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8733e3-3a99-40a1-b0c3-7008fb1de5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.077692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8733e3-3a99-40a1-b0c3-7008fb1de5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.078164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8733e3-3a99-40a1-b0c3-7008fb1de5d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.094634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8733e3-3a99-40a1-b0c3-7008fb1de5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-3a8733e3-3a99-40a1-b0c3-7008fb1de5d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:13.102891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:13.103777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:13.104589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:13.107348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 170/337] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:13.113411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f5e2e-c136-4c7a-b149-d294e4258e66 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:13.239551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f5e2e-c136-4c7a-b149-d294e4258e66 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:13.282082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:13.287886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e7617-94a4-43d6-b500-bb13b1810bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:13.288603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7617-94a4-43d6-b500-bb13b1810bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.288891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7617-94a4-43d6-b500-bb13b1810bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.295713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7617-94a4-43d6-b500-bb13b1810bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.295713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e7617-94a4-43d6-b500-bb13b1810bc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:13.295713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e7617-94a4-43d6-b500-bb13b1810bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:13.295713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e7617-94a4-43d6-b500-bb13b1810bc6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:13.308731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 168/338] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:13.314552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8733e3-3a99-40a1-b0c3-7008fb1de5d4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:13.316728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a180d17-1e00-4870-bf8b-b224326f5046 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.317017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a180d17-1e00-4870-bf8b-b224326f5046 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.317360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a180d17-1e00-4870-bf8b-b224326f5046 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.318627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 169/339] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:04:13.332957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c277519-d9a5-469e-b197-d9cc9a0f2e21 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.333300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c277519-d9a5-469e-b197-d9cc9a0f2e21 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.333519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c277519-d9a5-469e-b197-d9cc9a0f2e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.369439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2c277519-d9a5-469e-b197-d9cc9a0f2e21 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:13.370656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c277519-d9a5-469e-b197-d9cc9a0f2e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:13.526606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8733e3-3a99-40a1-b0c3-7008fb1de5d4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:13.530058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 170/340] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:13.565539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c277519-d9a5-469e-b197-d9cc9a0f2e21 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:13.591039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870064b-aeea-46c3-acf6-fd7b0d6d6d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:13.591739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870064b-aeea-46c3-acf6-fd7b0d6d6d06 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.592025 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870064b-aeea-46c3-acf6-fd7b0d6d6d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.592320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870064b-aeea-46c3-acf6-fd7b0d6d6d06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.606463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:13.669605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870064b-aeea-46c3-acf6-fd7b0d6d6d06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:13.671068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870064b-aeea-46c3-acf6-fd7b0d6d6d06 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:13.703013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c277519-d9a5-469e-b197-d9cc9a0f2e21 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:13.732752 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:13.745821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf857e8-b04a-493e-98ff-daa7871475a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:13.746909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf857e8-b04a-493e-98ff-daa7871475a1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.747357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf857e8-b04a-493e-98ff-daa7871475a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.748445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf857e8-b04a-493e-98ff-daa7871475a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.760183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf857e8-b04a-493e-98ff-daa7871475a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4bf857e8-b04a-493e-98ff-daa7871475a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:13.769662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:13.770562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:13.771374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:13.771970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 171/341] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:04:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:13.776226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4b0d-f64c-4952-a0ea-c8891f33c499 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.776226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4b0d-f64c-4952-a0ea-c8891f33c499 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.776226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4b0d-f64c-4952-a0ea-c8891f33c499 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.776226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 172/342] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:13.776226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffde0fe-2b7b-4de9-9936-a2dc2aaaab29 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.776226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffde0fe-2b7b-4de9-9936-a2dc2aaaab29 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.790594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffde0fe-2b7b-4de9-9936-a2dc2aaaab29 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.792561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 173/343] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:13 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:13.793643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79946038-9ea1-4fbf-97e5-60bb5f0a5431 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.793872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 171/344] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:13.794280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79946038-9ea1-4fbf-97e5-60bb5f0a5431 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.794280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79946038-9ea1-4fbf-97e5-60bb5f0a5431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.804161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870064b-aeea-46c3-acf6-fd7b0d6d6d06 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:13.818521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-79946038-9ea1-4fbf-97e5-60bb5f0a5431 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:13.819620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-79946038-9ea1-4fbf-97e5-60bb5f0a5431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:13.853022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:13.914595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870064b-aeea-46c3-acf6-fd7b0d6d6d06 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:13.921937 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 174/345] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:13.922804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79946038-9ea1-4fbf-97e5-60bb5f0a5431 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:13.953612 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea8be5-4b1e-4969-b493-7b121c04e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:13.954646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea8be5-4b1e-4969-b493-7b121c04e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.955132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea8be5-4b1e-4969-b493-7b121c04e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.955643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea8be5-4b1e-4969-b493-7b121c04e3a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.956626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea8be5-4b1e-4969-b493-7b121c04e3a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:13.957132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea8be5-4b1e-4969-b493-7b121c04e3a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:13.958685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea8be5-4b1e-4969-b493-7b121c04e3a1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:13.968275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 172/346] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:13.969900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf092c9-2d7c-4d97-97b1-6f39cc24ebcd None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:13.970396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf092c9-2d7c-4d97-97b1-6f39cc24ebcd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:13.970871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf092c9-2d7c-4d97-97b1-6f39cc24ebcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:13.989331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bdf092c9-2d7c-4d97-97b1-6f39cc24ebcd None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:13.990846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bdf092c9-2d7c-4d97-97b1-6f39cc24ebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:14.034188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79946038-9ea1-4fbf-97e5-60bb5f0a5431 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.048665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:14.063737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 173/347] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:14.064929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf092c9-2d7c-4d97-97b1-6f39cc24ebcd None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:14.072209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260ff6-6924-469c-ae4f-279b5808f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:14.073059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260ff6-6924-469c-ae4f-279b5808f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.073344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260ff6-6924-469c-ae4f-279b5808f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.073621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260ff6-6924-469c-ae4f-279b5808f6a9 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.074814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260ff6-6924-469c-ae4f-279b5808f6a9 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:14.076579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260ff6-6924-469c-ae4f-279b5808f6a9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:14.078609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 175/348] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:13 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:14.079590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260ff6-6924-469c-ae4f-279b5808f6a9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:14.104441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:14.177898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf092c9-2d7c-4d97-97b1-6f39cc24ebcd None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.186543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260ff6-6924-469c-ae4f-279b5808f6a9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.212759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a036751-726d-4fec-8729-7c03a1ebece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:14.214165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a036751-726d-4fec-8729-7c03a1ebece7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.214596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a036751-726d-4fec-8729-7c03a1ebece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.215017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a036751-726d-4fec-8729-7c03a1ebece7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.225372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065a1ad-94fd-4818-be5a-3797b90245db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:14.226083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065a1ad-94fd-4818-be5a-3797b90245db None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.226374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065a1ad-94fd-4818-be5a-3797b90245db None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.226652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065a1ad-94fd-4818-be5a-3797b90245db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.227840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a036751-726d-4fec-8729-7c03a1ebece7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8a036751-726d-4fec-8729-7c03a1ebece7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:14.236452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:14.237573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 03:04:14.238579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:14.240546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 174/349] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:14.241454 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a036751-726d-4fec-8729-7c03a1ebece7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:14.282854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:14.304357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065a1ad-94fd-4818-be5a-3797b90245db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:14.306072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065a1ad-94fd-4818-be5a-3797b90245db None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:14.349621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a036751-726d-4fec-8729-7c03a1ebece7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.352869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:14.401138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60358089-586b-4cb8-94fd-8c5d146b8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:14.402011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60358089-586b-4cb8-94fd-8c5d146b8d5c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.402463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60358089-586b-4cb8-94fd-8c5d146b8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.403231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60358089-586b-4cb8-94fd-8c5d146b8d5c None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.412513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60358089-586b-4cb8-94fd-8c5d146b8d5c None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:14.414208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60358089-586b-4cb8-94fd-8c5d146b8d5c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:14.417333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 175/350] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:14.418672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60358089-586b-4cb8-94fd-8c5d146b8d5c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:14.434714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 176/351] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:14.440086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065a1ad-94fd-4818-be5a-3797b90245db None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:14.544042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:14.556021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60358089-586b-4cb8-94fd-8c5d146b8d5c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.567105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065a1ad-94fd-4818-be5a-3797b90245db None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.602779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f99d0c-355d-4ebf-858a-bfa7b36dac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:14.606569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f99d0c-355d-4ebf-858a-bfa7b36dac85 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.606569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f99d0c-355d-4ebf-858a-bfa7b36dac85 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.606569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f99d0c-355d-4ebf-858a-bfa7b36dac85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.614279 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efb6c-39bf-4f4a-b718-7e37a5e0284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:14.614960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efb6c-39bf-4f4a-b718-7e37a5e0284c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.615244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efb6c-39bf-4f4a-b718-7e37a5e0284c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.615522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efb6c-39bf-4f4a-b718-7e37a5e0284c None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.616355 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66efb6c-39bf-4f4a-b718-7e37a5e0284c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:14.616618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66efb6c-39bf-4f4a-b718-7e37a5e0284c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:14.618079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66efb6c-39bf-4f4a-b718-7e37a5e0284c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:14.619255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f99d0c-355d-4ebf-858a-bfa7b36dac85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:14.627346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 177/352] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:14.628094 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efb6c-39bf-4f4a-b718-7e37a5e0284c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-40f99d0c-355d-4ebf-858a-bfa7b36dac85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:14.629750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:14.630676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:14.631533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:14.634819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 176/353] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:14.635870 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f99d0c-355d-4ebf-858a-bfa7b36dac85 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:14.659819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:14.765560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f99d0c-355d-4ebf-858a-bfa7b36dac85 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.768908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efb6c-39bf-4f4a-b718-7e37a5e0284c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.813420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074cf1a-0839-41f6-9501-dd259b7e91f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:14.813972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074cf1a-0839-41f6-9501-dd259b7e91f1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.813972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074cf1a-0839-41f6-9501-dd259b7e91f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.814293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074cf1a-0839-41f6-9501-dd259b7e91f1 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.815417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6765766-daa1-46ba-ae22-99ac77690b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:14.815539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074cf1a-0839-41f6-9501-dd259b7e91f1 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:14.816084 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6765766-daa1-46ba-ae22-99ac77690b0b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.817002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074cf1a-0839-41f6-9501-dd259b7e91f1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:14.819261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6765766-daa1-46ba-ae22-99ac77690b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.819261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6765766-daa1-46ba-ae22-99ac77690b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.819463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 177/354] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:14.819658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6765766-daa1-46ba-ae22-99ac77690b0b None admin] RBAC: Adding query filter params (group.id=2959e6c2bfd740489e20378247333cd0, role.id=64789f5937034a188d1774823d2387cb, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:14.819950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6765766-daa1-46ba-ae22-99ac77690b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:14.821461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcb0d7-48f1-4365-88ef-9c5d1c970d16 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.821461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcb0d7-48f1-4365-88ef-9c5d1c970d16 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.821461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcb0d7-48f1-4365-88ef-9c5d1c970d16 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.822653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 178/355] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:14.823225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcb0d7-48f1-4365-88ef-9c5d1c970d16 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:14.828644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6765766-daa1-46ba-ae22-99ac77690b0b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:14.843936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 178/356] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/role_assignments?group.id=2959e6c2bfd740489e20378247333cd0&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=64789f5937034a188d1774823d2387cb => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:14.843936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6765766-daa1-46ba-ae22-99ac77690b0b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:14.867521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:14.944984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:14.952829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcb0d7-48f1-4365-88ef-9c5d1c970d16 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.957184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6765766-daa1-46ba-ae22-99ac77690b0b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:14.992755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d457-a5c6-4983-8303-af890134697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:14.993719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d457-a5c6-4983-8303-af890134697a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:14.993998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d457-a5c6-4983-8303-af890134697a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:14.994274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d457-a5c6-4983-8303-af890134697a None admin] PATH_INFO: `/v3/users/3b3f3ef575b04fd397fa8788ef48479e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:14.995457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0d457-a5c6-4983-8303-af890134697a None admin] RBAC: Authorizing `identity:get_user(user_id=3b3f3ef575b04fd397fa8788ef48479e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:15.000731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0d457-a5c6-4983-8303-af890134697a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:15.000731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 179/357] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/users/3b3f3ef575b04fd397fa8788ef48479e => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:15.000731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d457-a5c6-4983-8303-af890134697a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:15.016423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72c4f2-83ee-49e6-ad57-4c6ecfa52651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:15.017120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72c4f2-83ee-49e6-ad57-4c6ecfa52651 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.017406 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72c4f2-83ee-49e6-ad57-4c6ecfa52651 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.017685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72c4f2-83ee-49e6-ad57-4c6ecfa52651 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.018462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72c4f2-83ee-49e6-ad57-4c6ecfa52651 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:15.018772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72c4f2-83ee-49e6-ad57-4c6ecfa52651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:15.022898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72c4f2-83ee-49e6-ad57-4c6ecfa52651 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:15.040621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 179/358] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:15.045283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6b94f-a096-47d8-b22b-e1f730018fba None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.045283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6b94f-a096-47d8-b22b-e1f730018fba None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.045283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6b94f-a096-47d8-b22b-e1f730018fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.065046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-eec6b94f-a096-47d8-b22b-e1f730018fba None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:15.066691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-eec6b94f-a096-47d8-b22b-e1f730018fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:15.143007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d457-a5c6-4983-8303-af890134697a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:15.147272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:15.155110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 180/359] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:15.156678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6b94f-a096-47d8-b22b-e1f730018fba None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:15.189114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838283b-ce27-45a7-8345-f32c4ca8be0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:15.189993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838283b-ce27-45a7-8345-f32c4ca8be0f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.190320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838283b-ce27-45a7-8345-f32c4ca8be0f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.190596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838283b-ce27-45a7-8345-f32c4ca8be0f None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.191821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838283b-ce27-45a7-8345-f32c4ca8be0f None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:15.193351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838283b-ce27-45a7-8345-f32c4ca8be0f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:15.196095 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 180/360] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:14 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:15.202059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293e8ce-373d-43b0-8aa5-734e2ef96e3e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.203000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293e8ce-373d-43b0-8aa5-734e2ef96e3e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.203000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293e8ce-373d-43b0-8aa5-734e2ef96e3e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.204464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 181/361] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:15.204687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293e8ce-373d-43b0-8aa5-734e2ef96e3e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:15.234364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:15.273576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6b94f-a096-47d8-b22b-e1f730018fba None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:15.322021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ff41-0113-4669-b04c-57bdfff9f493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:15.322682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ff41-0113-4669-b04c-57bdfff9f493 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.322969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ff41-0113-4669-b04c-57bdfff9f493 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.323248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ff41-0113-4669-b04c-57bdfff9f493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.324087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4ff41-0113-4669-b04c-57bdfff9f493 None admin] RBAC: Adding query filter params (role.id=c398a9e080af4ba68f03ea9f28debb38, user.id=3b3f3ef575b04fd397fa8788ef48479e, scope.system=all) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:15.324436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4ff41-0113-4669-b04c-57bdfff9f493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:15.325932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4ff41-0113-4669-b04c-57bdfff9f493 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:15.344339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 181/362] 10.222.0.15 () {56 vars in 1308 bytes} [Thu May 26 03:04:15 2022] GET /identity/v3/role_assignments?user.id=3b3f3ef575b04fd397fa8788ef48479e&scope.system=all&role.id=c398a9e080af4ba68f03ea9f28debb38 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:15.344339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ff41-0113-4669-b04c-57bdfff9f493 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:15.348590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293e8ce-373d-43b0-8aa5-734e2ef96e3e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:15.395148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb707987-2038-4bbb-bb4e-fb0d729a087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:15.395737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707987-2038-4bbb-bb4e-fb0d729a087a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.396030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707987-2038-4bbb-bb4e-fb0d729a087a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.396354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707987-2038-4bbb-bb4e-fb0d729a087a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.430258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:15.487414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb707987-2038-4bbb-bb4e-fb0d729a087a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:15.489257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb707987-2038-4bbb-bb4e-fb0d729a087a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:15.495697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ff41-0113-4669-b04c-57bdfff9f493 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:15.515651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:15.542301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb94d-4e73-4b9a-90c6-ad5e758c8332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:15.543430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb94d-4e73-4b9a-90c6-ad5e758c8332 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.543719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb94d-4e73-4b9a-90c6-ad5e758c8332 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.543993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb94d-4e73-4b9a-90c6-ad5e758c8332 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.560937 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56feb94d-4e73-4b9a-90c6-ad5e758c8332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-56feb94d-4e73-4b9a-90c6-ad5e758c8332 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:15.572294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:15.573313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:15.574120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:15.575257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 182/363] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:04:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:15.575432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb94d-4e73-4b9a-90c6-ad5e758c8332 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:15.627400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 182/364] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:15.629728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd344b-0ade-4e67-aa89-0bc728f24635 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.630024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd344b-0ade-4e67-aa89-0bc728f24635 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.630299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd344b-0ade-4e67-aa89-0bc728f24635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.649197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-74bd344b-0ade-4e67-aa89-0bc728f24635 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:15.650279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-74bd344b-0ade-4e67-aa89-0bc728f24635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:15.708457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb94d-4e73-4b9a-90c6-ad5e758c8332 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:15.730420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:15.738394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 183/365] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:15.740446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd344b-0ade-4e67-aa89-0bc728f24635 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:15.766409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5c81e-87dc-430d-85bd-4153297c007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:15.767383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c81e-87dc-430d-85bd-4153297c007d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.767928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c81e-87dc-430d-85bd-4153297c007d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.768338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c81e-87dc-430d-85bd-4153297c007d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.769496 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5c81e-87dc-430d-85bd-4153297c007d None admin] RBAC: Adding query filter params (group.id=2959e6c2bfd740489e20378247333cd0, role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:15.770025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5c81e-87dc-430d-85bd-4153297c007d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:15.771838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5c81e-87dc-430d-85bd-4153297c007d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:15.782940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 183/366] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:15 2022] GET /identity/v3/role_assignments?group.id=2959e6c2bfd740489e20378247333cd0&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:15.783969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5c81e-87dc-430d-85bd-4153297c007d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:15.802755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:15.877108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd344b-0ade-4e67-aa89-0bc728f24635 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:15.924057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5c81e-87dc-430d-85bd-4153297c007d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:15.930008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3210a-6b4c-47a5-a44e-3e4510d5d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:15.930701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3210a-6b4c-47a5-a44e-3e4510d5d0bd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.930984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3210a-6b4c-47a5-a44e-3e4510d5d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.931262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3210a-6b4c-47a5-a44e-3e4510d5d0bd None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.932119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3210a-6b4c-47a5-a44e-3e4510d5d0bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:15.932484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3210a-6b4c-47a5-a44e-3e4510d5d0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:15.934769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3210a-6b4c-47a5-a44e-3e4510d5d0bd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:15.947984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 184/367] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:15.949278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3210a-6b4c-47a5-a44e-3e4510d5d0bd None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:15.972867 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed79f39-627e-4c52-9d9a-b40888dfed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:15.973748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed79f39-627e-4c52-9d9a-b40888dfed38 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:15.974031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed79f39-627e-4c52-9d9a-b40888dfed38 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:15.974310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed79f39-627e-4c52-9d9a-b40888dfed38 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:15.977267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed79f39-627e-4c52-9d9a-b40888dfed38 None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:15.977845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed79f39-627e-4c52-9d9a-b40888dfed38 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:15.979971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 184/368] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:15 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:15.981181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed79f39-627e-4c52-9d9a-b40888dfed38 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:16.052708 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:16.081376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3210a-6b4c-47a5-a44e-3e4510d5d0bd None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:16.100414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:16.102714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed79f39-627e-4c52-9d9a-b40888dfed38 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:16.121419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf0164-8797-49b9-b2b4-912e52dfd1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:16.122252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0164-8797-49b9-b2b4-912e52dfd1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:16.122584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0164-8797-49b9-b2b4-912e52dfd1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:16.122862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0164-8797-49b9-b2b4-912e52dfd1e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:16.136159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf0164-8797-49b9-b2b4-912e52dfd1e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-cfdf0164-8797-49b9-b2b4-912e52dfd1e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:16.146845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:16.147756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:16.148579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:16.149190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e03692-5362-4fe3-a9fd-5aa21293999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:16.149289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 185/369] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:16.149366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e03692-5362-4fe3-a9fd-5aa21293999f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:16.149366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e03692-5362-4fe3-a9fd-5aa21293999f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:16.149366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e03692-5362-4fe3-a9fd-5aa21293999f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:16.149545 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf0164-8797-49b9-b2b4-912e52dfd1e7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:16.243199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e03692-5362-4fe3-a9fd-5aa21293999f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:16.244832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e03692-5362-4fe3-a9fd-5aa21293999f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:16.286439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf0164-8797-49b9-b2b4-912e52dfd1e7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:16.301375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:16.332236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a3a84-5ca1-42b1-860a-781ae52bdc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:16.333691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a3a84-5ca1-42b1-860a-781ae52bdc35 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:16.334176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a3a84-5ca1-42b1-860a-781ae52bdc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:16.334613 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a3a84-5ca1-42b1-860a-781ae52bdc35 None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:16.336333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a3a84-5ca1-42b1-860a-781ae52bdc35 None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:16.338130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a3a84-5ca1-42b1-860a-781ae52bdc35 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:16.341919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 186/370] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:16 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:16.343258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a3a84-5ca1-42b1-860a-781ae52bdc35 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:16.371167 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 185/371] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:16.371862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e03692-5362-4fe3-a9fd-5aa21293999f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:16.401138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:16.483310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a3a84-5ca1-42b1-860a-781ae52bdc35 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:16.488962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e03692-5362-4fe3-a9fd-5aa21293999f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:16.526464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1929-57d8-4e13-a14c-c82f05f3075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:16.526671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c07342-64c5-430c-9bee-801b76f5d68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:16.527184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c07342-64c5-430c-9bee-801b76f5d68c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:16.527476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c07342-64c5-430c-9bee-801b76f5d68c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:16.527755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c07342-64c5-430c-9bee-801b76f5d68c None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:16.528106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1929-57d8-4e13-a14c-c82f05f3075d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:16.528585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1929-57d8-4e13-a14c-c82f05f3075d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:16.528726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c07342-64c5-430c-9bee-801b76f5d68c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:16.528949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c07342-64c5-430c-9bee-801b76f5d68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:16.529352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1929-57d8-4e13-a14c-c82f05f3075d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:16.530349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f1929-57d8-4e13-a14c-c82f05f3075d None admin] RBAC: Adding query filter params (group.id=2959e6c2bfd740489e20378247333cd0, role.id=64789f5937034a188d1774823d2387cb, scope.project.id=6da20a2c16864901ae4e4966a4f38536) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:16.530460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c07342-64c5-430c-9bee-801b76f5d68c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:16.530927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f1929-57d8-4e13-a14c-c82f05f3075d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:16.532797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f1929-57d8-4e13-a14c-c82f05f3075d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:16.539058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 186/372] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:16 2022] GET /identity/v3/role_assignments?group.id=2959e6c2bfd740489e20378247333cd0&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=64789f5937034a188d1774823d2387cb => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:16.539295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 187/373] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:16.540265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1929-57d8-4e13-a14c-c82f05f3075d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:16.544921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c07342-64c5-430c-9bee-801b76f5d68c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:16.567992 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:16.684839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1929-57d8-4e13-a14c-c82f05f3075d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:16.692401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c07342-64c5-430c-9bee-801b76f5d68c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:16.694389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:16.743485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea66897-85d7-4bab-9b18-8b766ea2d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:16.744408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea66897-85d7-4bab-9b18-8b766ea2d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:16.744700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea66897-85d7-4bab-9b18-8b766ea2d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:16.744982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea66897-85d7-4bab-9b18-8b766ea2d0b6 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:16.747203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea66897-85d7-4bab-9b18-8b766ea2d0b6 None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:16.750071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea66897-85d7-4bab-9b18-8b766ea2d0b6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:16.752050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 187/374] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:16 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:16.759051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea66897-85d7-4bab-9b18-8b766ea2d0b6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:16.761403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30877-71ef-4eb8-b59e-e25daf275330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:16.762083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30877-71ef-4eb8-b59e-e25daf275330 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:16.762388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30877-71ef-4eb8-b59e-e25daf275330 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:16.762653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30877-71ef-4eb8-b59e-e25daf275330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:16.881043 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30877-71ef-4eb8-b59e-e25daf275330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:16.882360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30877-71ef-4eb8-b59e-e25daf275330 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:16.892803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:16.917868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea66897-85d7-4bab-9b18-8b766ea2d0b6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:16.960367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e725dc6-214f-47e1-9802-8ddaffd542bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:16.961614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e725dc6-214f-47e1-9802-8ddaffd542bf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:16.962113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e725dc6-214f-47e1-9802-8ddaffd542bf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:16.962596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e725dc6-214f-47e1-9802-8ddaffd542bf None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:16.964251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e725dc6-214f-47e1-9802-8ddaffd542bf None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:16.965974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e725dc6-214f-47e1-9802-8ddaffd542bf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:16.968153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 188/375] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:16 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:16.973652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e725dc6-214f-47e1-9802-8ddaffd542bf None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:17.076195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 188/376] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:17.081593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30877-71ef-4eb8-b59e-e25daf275330 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:17.083752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:17.101636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e725dc6-214f-47e1-9802-8ddaffd542bf None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:17.180848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c516d4-f0cf-4e6f-a6e3-89382e368967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:17.181886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c516d4-f0cf-4e6f-a6e3-89382e368967 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:17.182380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c516d4-f0cf-4e6f-a6e3-89382e368967 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:17.182852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c516d4-f0cf-4e6f-a6e3-89382e368967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:17.183891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c516d4-f0cf-4e6f-a6e3-89382e368967 None admin] RBAC: Adding query filter params (group.id=2959e6c2bfd740489e20378247333cd0, role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=6da20a2c16864901ae4e4966a4f38536) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:17.186232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c516d4-f0cf-4e6f-a6e3-89382e368967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:17.187887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c516d4-f0cf-4e6f-a6e3-89382e368967 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:17.202043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 189/377] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:16 2022] GET /identity/v3/role_assignments?group.id=2959e6c2bfd740489e20378247333cd0&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:17.259404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30877-71ef-4eb8-b59e-e25daf275330 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:17.316129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d97a4-3a01-4cee-ae48-3fb2ab19b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:17.317418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d97a4-3a01-4cee-ae48-3fb2ab19b899 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:17.317970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d97a4-3a01-4cee-ae48-3fb2ab19b899 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:17.318444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d97a4-3a01-4cee-ae48-3fb2ab19b899 None admin] PATH_INFO: `/v3/projects/2bc9d186e27441d983463d38b1cc22e5` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:17.320000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d97a4-3a01-4cee-ae48-3fb2ab19b899 None admin] RBAC: Authorizing `identity:get_project(project_id=2bc9d186e27441d983463d38b1cc22e5)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:17.321796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d97a4-3a01-4cee-ae48-3fb2ab19b899 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:17.323872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 189/378] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:17 2022] GET /identity/v3/projects/2bc9d186e27441d983463d38b1cc22e5 => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:17.331239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c516d4-f0cf-4e6f-a6e3-89382e368967 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:17.352693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:17.459005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c516d4-f0cf-4e6f-a6e3-89382e368967 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:17.490261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3851c-f41c-44cf-ad8e-46c4a5be10f1 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:17.490544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3851c-f41c-44cf-ad8e-46c4a5be10f1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:17.490822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3851c-f41c-44cf-ad8e-46c4a5be10f1 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:17.492342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 190/379] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:17.497606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2cd32-8731-4d03-8c07-fbdf09e261e0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:17.498121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2cd32-8731-4d03-8c07-fbdf09e261e0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:17.498615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2cd32-8731-4d03-8c07-fbdf09e261e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:17.502090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1309-a038-451e-ac46-e98a2f4e6a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:17.502952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1309-a038-451e-ac46-e98a2f4e6a9d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:17.503302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1309-a038-451e-ac46-e98a2f4e6a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:17.503580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1309-a038-451e-ac46-e98a2f4e6a9d None admin] PATH_INFO: `/v3/groups/bd8e0f6834194ef5a8840d6638cea02c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:17.515843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a1309-a038-451e-ac46-e98a2f4e6a9d None admin] RBAC: Authorizing `identity:get_group(group_id=bd8e0f6834194ef5a8840d6638cea02c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:17.517793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a1309-a038-451e-ac46-e98a2f4e6a9d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:17.519945 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 190/380] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:17 2022] GET /identity/v3/groups/bd8e0f6834194ef5a8840d6638cea02c => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:17.523162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-40e2cd32-8731-4d03-8c07-fbdf09e261e0 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:17.524632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-40e2cd32-8731-4d03-8c07-fbdf09e261e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:17.526458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1309-a038-451e-ac46-e98a2f4e6a9d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:17.622380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:17.645605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1309-a038-451e-ac46-e98a2f4e6a9d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:17.683666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adf459-ad6b-450b-98d4-a1ebfce1c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:17.684340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf459-ad6b-450b-98d4-a1ebfce1c7ed None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:17.684632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf459-ad6b-450b-98d4-a1ebfce1c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:17.684938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adf459-ad6b-450b-98d4-a1ebfce1c7ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:17.685803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adf459-ad6b-450b-98d4-a1ebfce1c7ed None admin] RBAC: Adding query filter params (group.id=bd8e0f6834194ef5a8840d6638cea02c, role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=2bc9d186e27441d983463d38b1cc22e5) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:17.686120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adf459-ad6b-450b-98d4-a1ebfce1c7ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:17.687565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adf459-ad6b-450b-98d4-a1ebfce1c7ed None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:17.694110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 191/381] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:17 2022] GET /identity/v3/role_assignments?group.id=bd8e0f6834194ef5a8840d6638cea02c&scope.project.id=2bc9d186e27441d983463d38b1cc22e5&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:17.705339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:17.715270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 191/382] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:17.747881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adf459-ad6b-450b-98d4-a1ebfce1c7ed None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:17.879521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adf459-ad6b-450b-98d4-a1ebfce1c7ed None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:17.919799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5e545-f08a-4ea5-a248-e6a09c916265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:17.920632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e545-f08a-4ea5-a248-e6a09c916265 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:17.920917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e545-f08a-4ea5-a248-e6a09c916265 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:17.921193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e545-f08a-4ea5-a248-e6a09c916265 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:17.936132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:17.939706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5e545-f08a-4ea5-a248-e6a09c916265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-85a5e545-f08a-4ea5-a248-e6a09c916265 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:17.947465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:17.948377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:17.949201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 192/383] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:17.961492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2cd32-8731-4d03-8c07-fbdf09e261e0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:18.083819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2cd32-8731-4d03-8c07-fbdf09e261e0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:18.123898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf61b-f2d2-4118-9ee6-7aee1e5fd89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:18.124697 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf61b-f2d2-4118-9ee6-7aee1e5fd89d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:18.124991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf61b-f2d2-4118-9ee6-7aee1e5fd89d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:18.125269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf61b-f2d2-4118-9ee6-7aee1e5fd89d None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:18.126027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbf61b-f2d2-4118-9ee6-7aee1e5fd89d None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:18.126337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbf61b-f2d2-4118-9ee6-7aee1e5fd89d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:18.127706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbf61b-f2d2-4118-9ee6-7aee1e5fd89d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:18.136935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 192/384] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:18.143046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5e545-f08a-4ea5-a248-e6a09c916265 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:18.279933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5e545-f08a-4ea5-a248-e6a09c916265 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:18.321444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94b888-cf16-46a1-997e-99d3a434204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:18.322318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94b888-cf16-46a1-997e-99d3a434204b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:18.322603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94b888-cf16-46a1-997e-99d3a434204b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:18.322879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94b888-cf16-46a1-997e-99d3a434204b None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:18.325075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94b888-cf16-46a1-997e-99d3a434204b None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:18.326816 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94b888-cf16-46a1-997e-99d3a434204b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:18.329030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 193/385] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:18 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:18.334162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf61b-f2d2-4118-9ee6-7aee1e5fd89d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:18.412955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:18.469514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf61b-f2d2-4118-9ee6-7aee1e5fd89d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:18.520008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475e228-b4e4-4433-88fc-059e92eb94c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:18.521242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e228-b4e4-4433-88fc-059e92eb94c0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:18.521751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e228-b4e4-4433-88fc-059e92eb94c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:18.522278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e228-b4e4-4433-88fc-059e92eb94c0 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:18.523706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475e228-b4e4-4433-88fc-059e92eb94c0 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:18.525406 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475e228-b4e4-4433-88fc-059e92eb94c0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:18.527307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 193/386] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:18 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:18.533116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94b888-cf16-46a1-997e-99d3a434204b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:18.549259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad4544-2068-4264-a62a-3710c349c4ed None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:18.549926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad4544-2068-4264-a62a-3710c349c4ed None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:18.550407 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad4544-2068-4264-a62a-3710c349c4ed None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:18.553052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 194/387] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:18.571967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363a49-119d-4f86-a09b-2b2cb09beeae None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:18.572576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363a49-119d-4f86-a09b-2b2cb09beeae None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:18.573061 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363a49-119d-4f86-a09b-2b2cb09beeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:18.594893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-55363a49-119d-4f86-a09b-2b2cb09beeae None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:18.597715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-55363a49-119d-4f86-a09b-2b2cb09beeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:18.671721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:18.694382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 195/388] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:18.718786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363a49-119d-4f86-a09b-2b2cb09beeae None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:18.729622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94b888-cf16-46a1-997e-99d3a434204b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:18.786351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72568cc5-6130-4089-9237-5931bcca3b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:18.786351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72568cc5-6130-4089-9237-5931bcca3b60 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:18.786605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72568cc5-6130-4089-9237-5931bcca3b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:18.786700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72568cc5-6130-4089-9237-5931bcca3b60 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/groups/2959e6c2bfd740489e20378247333cd0/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:18.792810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72568cc5-6130-4089-9237-5931bcca3b60 None admin] RBAC: Authorizing `identity:create_grant(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4, group_id=2959e6c2bfd740489e20378247333cd0, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:18.792810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72568cc5-6130-4089-9237-5931bcca3b60 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:18.816444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:18.861035 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363a49-119d-4f86-a09b-2b2cb09beeae None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:18.879944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 194/389] 10.222.0.15 () {58 vars in 1442 bytes} [Thu May 26 03:04:18 2022] PUT /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/groups/2959e6c2bfd740489e20378247333cd0/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:18.910276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2d57d-ce7c-4170-ab9d-ad8425566385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:18.911088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2d57d-ce7c-4170-ab9d-ad8425566385 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:18.911403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2d57d-ce7c-4170-ab9d-ad8425566385 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:18.911681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2d57d-ce7c-4170-ab9d-ad8425566385 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:18.928670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2d57d-ce7c-4170-ab9d-ad8425566385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a5f2d57d-ce7c-4170-ab9d-ad8425566385 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:18.937040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:18.937904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:18.938708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 196/390] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:04:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:18.944582 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72568cc5-6130-4089-9237-5931bcca3b60 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:19.065819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72568cc5-6130-4089-9237-5931bcca3b60 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:19.101280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:19.112226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc06d-f327-4834-8e99-4a9b8329e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:19.112971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc06d-f327-4834-8e99-4a9b8329e62f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:19.117908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc06d-f327-4834-8e99-4a9b8329e62f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:19.117908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc06d-f327-4834-8e99-4a9b8329e62f None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:19.117908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc06d-f327-4834-8e99-4a9b8329e62f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:19.117908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc06d-f327-4834-8e99-4a9b8329e62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:19.117908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc06d-f327-4834-8e99-4a9b8329e62f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:19.129826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 195/391] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:19.135174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2d57d-ce7c-4170-ab9d-ad8425566385 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:19.269402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2d57d-ce7c-4170-ab9d-ad8425566385 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:19.291259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:19.310443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2552-d019-4444-ad3b-281e0a6f7381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:19.311312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2552-d019-4444-ad3b-281e0a6f7381 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:19.311594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2552-d019-4444-ad3b-281e0a6f7381 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:19.311868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2552-d019-4444-ad3b-281e0a6f7381 None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:19.313094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2552-d019-4444-ad3b-281e0a6f7381 None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:19.314570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2552-d019-4444-ad3b-281e0a6f7381 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:19.320564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 197/392] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:19 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:19.325068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc06d-f327-4834-8e99-4a9b8329e62f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:19.470575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc06d-f327-4834-8e99-4a9b8329e62f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:19.508588 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7a5fe-ba8f-4978-82a5-6a75d9196cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:19.509829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7a5fe-ba8f-4978-82a5-6a75d9196cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:19.510307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7a5fe-ba8f-4978-82a5-6a75d9196cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:19.510788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7a5fe-ba8f-4978-82a5-6a75d9196cb1 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:19.512175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7a5fe-ba8f-4978-82a5-6a75d9196cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:19.514399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7a5fe-ba8f-4978-82a5-6a75d9196cb1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:19.518843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 196/393] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:19 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:19.521989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2552-d019-4444-ad3b-281e0a6f7381 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:19.617879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb496cad-f318-4dda-aeab-27f2178ac451 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:19.618238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb496cad-f318-4dda-aeab-27f2178ac451 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:19.618430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb496cad-f318-4dda-aeab-27f2178ac451 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:19.620153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 197/394] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:19.625705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c04a33-f58e-4e0a-8e56-4b295269ae6f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:19.625989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c04a33-f58e-4e0a-8e56-4b295269ae6f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:19.626272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c04a33-f58e-4e0a-8e56-4b295269ae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:19.639872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2552-d019-4444-ad3b-281e0a6f7381 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:19.665355 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-06c04a33-f58e-4e0a-8e56-4b295269ae6f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:19.666563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-06c04a33-f58e-4e0a-8e56-4b295269ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:19.674389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef32ff7-1838-4076-bd13-2c57ae6ce371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:19.675283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef32ff7-1838-4076-bd13-2c57ae6ce371 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:19.675565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef32ff7-1838-4076-bd13-2c57ae6ce371 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:19.675852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef32ff7-1838-4076-bd13-2c57ae6ce371 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/groups/2959e6c2bfd740489e20378247333cd0/roles/90baedc1773f4d67ae7e85fa74a93b5d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:19.678174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef32ff7-1838-4076-bd13-2c57ae6ce371 None admin] RBAC: Authorizing `identity:create_grant(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4, group_id=2959e6c2bfd740489e20378247333cd0, role_id=90baedc1773f4d67ae7e85fa74a93b5d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:19.679622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef32ff7-1838-4076-bd13-2c57ae6ce371 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:19.732539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:19.749545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 198/395] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:19.754146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 198/396] 10.222.0.15 () {58 vars in 1442 bytes} [Thu May 26 03:04:19 2022] PUT /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4/groups/2959e6c2bfd740489e20378247333cd0/roles/90baedc1773f4d67ae7e85fa74a93b5d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:19.795514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c04a33-f58e-4e0a-8e56-4b295269ae6f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:19.937183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c04a33-f58e-4e0a-8e56-4b295269ae6f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:19.972301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b15ab-0b24-4975-98b2-e5791fd949d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:19.973122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b15ab-0b24-4975-98b2-e5791fd949d2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:19.973406 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b15ab-0b24-4975-98b2-e5791fd949d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:19.973684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b15ab-0b24-4975-98b2-e5791fd949d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:19.985610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b15ab-0b24-4975-98b2-e5791fd949d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d58b15ab-0b24-4975-98b2-e5791fd949d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:19.993515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:19.994519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:19.995326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 199/397] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:20.001614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef32ff7-1838-4076-bd13-2c57ae6ce371 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:20.061461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:20.109958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef32ff7-1838-4076-bd13-2c57ae6ce371 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:20.145591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daaafd-a988-4081-ad55-643d3c330b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:20.146266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daaafd-a988-4081-ad55-643d3c330b71 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.146553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daaafd-a988-4081-ad55-643d3c330b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.146832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daaafd-a988-4081-ad55-643d3c330b71 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.147577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daaafd-a988-4081-ad55-643d3c330b71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:20.147887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daaafd-a988-4081-ad55-643d3c330b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:20.149270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daaafd-a988-4081-ad55-643d3c330b71 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:20.158656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 199/398] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:20.164232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b15ab-0b24-4975-98b2-e5791fd949d2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:20.217351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:20.257209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eca828-acfd-42d9-a82a-349ee01b4214 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.257499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eca828-acfd-42d9-a82a-349ee01b4214 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.257771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eca828-acfd-42d9-a82a-349ee01b4214 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.260422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 200/399] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:04:20.265100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d0f9b-f248-4ed8-816d-8086f4b2ce08 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.265388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d0f9b-f248-4ed8-816d-8086f4b2ce08 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.265710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d0f9b-f248-4ed8-816d-8086f4b2ce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.270416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b15ab-0b24-4975-98b2-e5791fd949d2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:20.302063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9b2d0f9b-f248-4ed8-816d-8086f4b2ce08 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:20.304892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9b2d0f9b-f248-4ed8-816d-8086f4b2ce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:20.319897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fedfc-5cfa-4906-adc9-eb6153690d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:20.321144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fedfc-5cfa-4906-adc9-eb6153690d4f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.321627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fedfc-5cfa-4906-adc9-eb6153690d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.322138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fedfc-5cfa-4906-adc9-eb6153690d4f None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.324362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fedfc-5cfa-4906-adc9-eb6153690d4f None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:20.326183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fedfc-5cfa-4906-adc9-eb6153690d4f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:20.330654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 200/400] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:20 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:20.336538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fedfc-5cfa-4906-adc9-eb6153690d4f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:20.420088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 201/401] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:20.453744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d0f9b-f248-4ed8-816d-8086f4b2ce08 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:20.524689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:20.533973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fedfc-5cfa-4906-adc9-eb6153690d4f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:20.565859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:20.568975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611299a7-28fc-4b57-9ea4-a109eb8e0257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:20.569839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611299a7-28fc-4b57-9ea4-a109eb8e0257 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.570177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611299a7-28fc-4b57-9ea4-a109eb8e0257 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.570401 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611299a7-28fc-4b57-9ea4-a109eb8e0257 None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.572859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611299a7-28fc-4b57-9ea4-a109eb8e0257 None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:20.573245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611299a7-28fc-4b57-9ea4-a109eb8e0257 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:20.584334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 201/402] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:20 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:20.584334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611299a7-28fc-4b57-9ea4-a109eb8e0257 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:20.597485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d0f9b-f248-4ed8-816d-8086f4b2ce08 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:20.631052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9d5f5-f04c-4360-a8ee-ac07ef5b8500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:20.631867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9d5f5-f04c-4360-a8ee-ac07ef5b8500 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.632151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9d5f5-f04c-4360-a8ee-ac07ef5b8500 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.632455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9d5f5-f04c-4360-a8ee-ac07ef5b8500 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.643342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9d5f5-f04c-4360-a8ee-ac07ef5b8500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-efb9d5f5-f04c-4360-a8ee-ac07ef5b8500 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:20.651706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:20.652716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:20.653571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 202/403] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:04:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:20.655386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e67e2-c35e-41ad-b9a8-5aa89aa81453 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.655674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e67e2-c35e-41ad-b9a8-5aa89aa81453 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.655952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e67e2-c35e-41ad-b9a8-5aa89aa81453 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.664611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 203/404] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:20.665824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e67e2-c35e-41ad-b9a8-5aa89aa81453 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:20.705298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611299a7-28fc-4b57-9ea4-a109eb8e0257 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:20.750239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8114968-9f3d-4248-aa13-de0f5f9a558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:20.751289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8114968-9f3d-4248-aa13-de0f5f9a558b None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.751679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8114968-9f3d-4248-aa13-de0f5f9a558b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.752064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8114968-9f3d-4248-aa13-de0f5f9a558b None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536/groups/2959e6c2bfd740489e20378247333cd0/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.755079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8114968-9f3d-4248-aa13-de0f5f9a558b None admin] RBAC: Authorizing `identity:create_grant(project_id=6da20a2c16864901ae4e4966a4f38536, group_id=2959e6c2bfd740489e20378247333cd0, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:20.757006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8114968-9f3d-4248-aa13-de0f5f9a558b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:20.777641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:20.782885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e67e2-c35e-41ad-b9a8-5aa89aa81453 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:20.821970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd011b-f53c-4dcf-96d4-fca41daed3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:20.822581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd011b-f53c-4dcf-96d4-fca41daed3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.822867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd011b-f53c-4dcf-96d4-fca41daed3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.823145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd011b-f53c-4dcf-96d4-fca41daed3f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.823890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd011b-f53c-4dcf-96d4-fca41daed3f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:20.824200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd011b-f53c-4dcf-96d4-fca41daed3f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:20.826151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd011b-f53c-4dcf-96d4-fca41daed3f9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:20.834896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 204/405] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:20.840042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b91a4-9ec2-4f31-bd62-ff33eec0b6ec None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:20.840042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b91a4-9ec2-4f31-bd62-ff33eec0b6ec None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:20.840042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b91a4-9ec2-4f31-bd62-ff33eec0b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:20.855663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0e4b91a4-9ec2-4f31-bd62-ff33eec0b6ec None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:20.856896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0e4b91a4-9ec2-4f31-bd62-ff33eec0b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:20.868663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 202/406] 10.222.0.15 () {58 vars in 1442 bytes} [Thu May 26 03:04:20 2022] PUT /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536/groups/2959e6c2bfd740489e20378247333cd0/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:20.870280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8114968-9f3d-4248-aa13-de0f5f9a558b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:20.982332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:21.002827 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 205/407] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:21.037324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b91a4-9ec2-4f31-bd62-ff33eec0b6ec None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:21.074003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8114968-9f3d-4248-aa13-de0f5f9a558b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:21.129970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd2578-e2e1-4e19-8926-74800861df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:21.131181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd2578-e2e1-4e19-8926-74800861df73 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:21.131658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd2578-e2e1-4e19-8926-74800861df73 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:21.132127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd2578-e2e1-4e19-8926-74800861df73 None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:21.133662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd2578-e2e1-4e19-8926-74800861df73 None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:21.135317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd2578-e2e1-4e19-8926-74800861df73 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:21.137185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 203/408] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:20 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:21.149313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd2578-e2e1-4e19-8926-74800861df73 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:21.161050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:21.171498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b91a4-9ec2-4f31-bd62-ff33eec0b6ec None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:21.211969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06214f19-02a1-4ce4-98f3-dab70d3dde6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:21.213103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06214f19-02a1-4ce4-98f3-dab70d3dde6c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:21.213955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06214f19-02a1-4ce4-98f3-dab70d3dde6c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:21.214381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06214f19-02a1-4ce4-98f3-dab70d3dde6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:21.226766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06214f19-02a1-4ce4-98f3-dab70d3dde6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-06214f19-02a1-4ce4-98f3-dab70d3dde6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:21.235715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:21.236861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:21.237864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:21.240209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 206/409] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:21.246041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06214f19-02a1-4ce4-98f3-dab70d3dde6c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:21.322353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd2578-e2e1-4e19-8926-74800861df73 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:21.336923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:21.370316 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f398ea6-8b32-498b-bc19-3787a1924b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:21.371537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f398ea6-8b32-498b-bc19-3787a1924b3d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:21.371996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f398ea6-8b32-498b-bc19-3787a1924b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:21.373026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f398ea6-8b32-498b-bc19-3787a1924b3d None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:21.375137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f398ea6-8b32-498b-bc19-3787a1924b3d None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:21.377773 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f398ea6-8b32-498b-bc19-3787a1924b3d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:21.383332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 204/410] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:21 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:21.389717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f398ea6-8b32-498b-bc19-3787a1924b3d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:21.448096 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06214f19-02a1-4ce4-98f3-dab70d3dde6c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:21.505058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f398ea6-8b32-498b-bc19-3787a1924b3d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:21.536471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02dc0e-bae1-4024-a1b0-93b24f38b84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:21.537625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02dc0e-bae1-4024-a1b0-93b24f38b84b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:21.538869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02dc0e-bae1-4024-a1b0-93b24f38b84b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:21.540017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02dc0e-bae1-4024-a1b0-93b24f38b84b None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:21.541157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02dc0e-bae1-4024-a1b0-93b24f38b84b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:21.542779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02dc0e-bae1-4024-a1b0-93b24f38b84b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:21.545817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02dc0e-bae1-4024-a1b0-93b24f38b84b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:21.553340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45a95-52da-478b-a4e9-4dbd14cc41cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:21.556291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45a95-52da-478b-a4e9-4dbd14cc41cd None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:21.556876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45a95-52da-478b-a4e9-4dbd14cc41cd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:21.557359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45a95-52da-478b-a4e9-4dbd14cc41cd None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536/groups/2959e6c2bfd740489e20378247333cd0/roles/90baedc1773f4d67ae7e85fa74a93b5d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:21.560282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 207/411] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:21.561741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf45a95-52da-478b-a4e9-4dbd14cc41cd None admin] RBAC: Authorizing `identity:create_grant(project_id=6da20a2c16864901ae4e4966a4f38536, group_id=2959e6c2bfd740489e20378247333cd0, role_id=90baedc1773f4d67ae7e85fa74a93b5d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:21.563414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf45a95-52da-478b-a4e9-4dbd14cc41cd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:21.565688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02dc0e-bae1-4024-a1b0-93b24f38b84b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:21.591683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:21.655667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 205/412] 10.222.0.15 () {58 vars in 1442 bytes} [Thu May 26 03:04:21 2022] PUT /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536/groups/2959e6c2bfd740489e20378247333cd0/roles/90baedc1773f4d67ae7e85fa74a93b5d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:21.702498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02dc0e-bae1-4024-a1b0-93b24f38b84b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:21.750580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ce86f-d1de-4562-9ea9-aab61c375591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:21.751471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce86f-d1de-4562-9ea9-aab61c375591 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:21.751755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce86f-d1de-4562-9ea9-aab61c375591 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:21.752033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce86f-d1de-4562-9ea9-aab61c375591 None admin] PATH_INFO: `/v3/groups/bd8e0f6834194ef5a8840d6638cea02c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:21.753335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ce86f-d1de-4562-9ea9-aab61c375591 None admin] RBAC: Authorizing `identity:get_group(group_id=bd8e0f6834194ef5a8840d6638cea02c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:21.754804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ce86f-d1de-4562-9ea9-aab61c375591 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:21.756898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 208/413] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:21 2022] GET /identity/v3/groups/bd8e0f6834194ef5a8840d6638cea02c => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:21.762221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45a95-52da-478b-a4e9-4dbd14cc41cd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:21.832089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:21.848972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b21ff-f7c1-4ca1-b360-23d56bd5612c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:21.849189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b21ff-f7c1-4ca1-b360-23d56bd5612c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:21.849480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b21ff-f7c1-4ca1-b360-23d56bd5612c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:21.851159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 209/414] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:21.857545 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcf175-e7bf-4efe-a85e-53f0a03a2d5b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:21.857834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcf175-e7bf-4efe-a85e-53f0a03a2d5b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:21.858116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcf175-e7bf-4efe-a85e-53f0a03a2d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:21.889448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-54dcf175-e7bf-4efe-a85e-53f0a03a2d5b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:21.891821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-54dcf175-e7bf-4efe-a85e-53f0a03a2d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:21.914163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45a95-52da-478b-a4e9-4dbd14cc41cd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:21.958951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69538f-d156-4ebd-b723-c5ea05dd8d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:21.960172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69538f-d156-4ebd-b723-c5ea05dd8d0b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:21.960663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69538f-d156-4ebd-b723-c5ea05dd8d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:21.961143 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69538f-d156-4ebd-b723-c5ea05dd8d0b None admin] PATH_INFO: `/v3/projects/2bc9d186e27441d983463d38b1cc22e5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:21.962515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69538f-d156-4ebd-b723-c5ea05dd8d0b None admin] RBAC: Authorizing `identity:get_project(project_id=2bc9d186e27441d983463d38b1cc22e5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:21.966355 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69538f-d156-4ebd-b723-c5ea05dd8d0b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:21.968691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 206/415] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:21 2022] GET /identity/v3/projects/2bc9d186e27441d983463d38b1cc22e5 => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:21.974295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69538f-d156-4ebd-b723-c5ea05dd8d0b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:21.999496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 210/416] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:22.025629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcf175-e7bf-4efe-a85e-53f0a03a2d5b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:22.043655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:22.135559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69538f-d156-4ebd-b723-c5ea05dd8d0b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:22.145942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:22.178873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec29b-3e3f-410e-a634-4eb8f9215f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:22.179760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec29b-3e3f-410e-a634-4eb8f9215f66 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:22.180044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec29b-3e3f-410e-a634-4eb8f9215f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:22.180334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec29b-3e3f-410e-a634-4eb8f9215f66 None admin] PATH_INFO: `/v3/projects/2bc9d186e27441d983463d38b1cc22e5/groups/bd8e0f6834194ef5a8840d6638cea02c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:22.183828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec29b-3e3f-410e-a634-4eb8f9215f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bc9d186e27441d983463d38b1cc22e5, group_id=bd8e0f6834194ef5a8840d6638cea02c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:22.186266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec29b-3e3f-410e-a634-4eb8f9215f66 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:22.213269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcf175-e7bf-4efe-a85e-53f0a03a2d5b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:22.253722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046ce84-f527-4ccd-9079-cb963ed96bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:22.254773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046ce84-f527-4ccd-9079-cb963ed96bfa None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:22.255207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046ce84-f527-4ccd-9079-cb963ed96bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:22.255657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046ce84-f527-4ccd-9079-cb963ed96bfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:22.256113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 207/417] 10.222.0.15 () {58 vars in 1442 bytes} [Thu May 26 03:04:21 2022] PUT /identity/v3/projects/2bc9d186e27441d983463d38b1cc22e5/groups/bd8e0f6834194ef5a8840d6638cea02c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:22.276395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046ce84-f527-4ccd-9079-cb963ed96bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c046ce84-f527-4ccd-9079-cb963ed96bfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:22.285591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:22.286759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:22.287783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:22.290447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 211/418] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:22.296567 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec29b-3e3f-410e-a634-4eb8f9215f66 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:22.431904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec29b-3e3f-410e-a634-4eb8f9215f66 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:22.475611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb46972-6182-4744-b565-f1c9099083c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:22.476626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb46972-6182-4744-b565-f1c9099083c8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:22.477089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb46972-6182-4744-b565-f1c9099083c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:22.477515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb46972-6182-4744-b565-f1c9099083c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:22.478430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb46972-6182-4744-b565-f1c9099083c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:22.478895 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb46972-6182-4744-b565-f1c9099083c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:22.480529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb46972-6182-4744-b565-f1c9099083c8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:22.490521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 208/419] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:22.496283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046ce84-f527-4ccd-9079-cb963ed96bfa None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:22.595450 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:22.618537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9301c1-84fc-4c95-aa01-b10bac0940cf None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:22.619060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9301c1-84fc-4c95-aa01-b10bac0940cf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:22.619492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9301c1-84fc-4c95-aa01-b10bac0940cf None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:22.621327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 209/420] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:22.627340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cff721-fa5a-4c40-9769-9917029692f4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:22.627881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cff721-fa5a-4c40-9769-9917029692f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:22.628398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cff721-fa5a-4c40-9769-9917029692f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:22.635478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046ce84-f527-4ccd-9079-cb963ed96bfa None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:22.647016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c9cff721-fa5a-4c40-9769-9917029692f4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:22.648540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c9cff721-fa5a-4c40-9769-9917029692f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:22.675713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:22.693547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd749c-96e1-4d2e-909c-e21b511ec9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:22.693547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd749c-96e1-4d2e-909c-e21b511ec9fa None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:22.693547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd749c-96e1-4d2e-909c-e21b511ec9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:22.693547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd749c-96e1-4d2e-909c-e21b511ec9fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:22.724522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 210/421] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:22.766500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cff721-fa5a-4c40-9769-9917029692f4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:22.801912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd749c-96e1-4d2e-909c-e21b511ec9fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:22.803390 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd749c-96e1-4d2e-909c-e21b511ec9fa None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:22.917982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:22.957303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cff721-fa5a-4c40-9769-9917029692f4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:22.980477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 212/422] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:22.987346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd749c-96e1-4d2e-909c-e21b511ec9fa None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:23.028922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849c04-98e1-43e2-b86e-dc86659f30a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:23.029742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849c04-98e1-43e2-b86e-dc86659f30a6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:23.030031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849c04-98e1-43e2-b86e-dc86659f30a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:23.030312 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849c04-98e1-43e2-b86e-dc86659f30a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:23.060936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b849c04-98e1-43e2-b86e-dc86659f30a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2b849c04-98e1-43e2-b86e-dc86659f30a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:23.077944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:23.078910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:23.079759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:23.082661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 211/423] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:04:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:23.088137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849c04-98e1-43e2-b86e-dc86659f30a6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:23.120618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd749c-96e1-4d2e-909c-e21b511ec9fa None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:23.131231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:23.166943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac99a7-b629-4e4c-a505-191d0c0a8994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:23.168226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac99a7-b629-4e4c-a505-191d0c0a8994 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:23.168905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac99a7-b629-4e4c-a505-191d0c0a8994 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:23.169410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac99a7-b629-4e4c-a505-191d0c0a8994 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:23.170878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac99a7-b629-4e4c-a505-191d0c0a8994 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:23.172564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac99a7-b629-4e4c-a505-191d0c0a8994 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:23.174895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 213/424] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:22 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:23.189288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac99a7-b629-4e4c-a505-191d0c0a8994 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:23.277279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:23.306539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849c04-98e1-43e2-b86e-dc86659f30a6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:23.345356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac99a7-b629-4e4c-a505-191d0c0a8994 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:23.387204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a17c81-f730-4302-9c15-3d6ca631fa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:23.388661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a17c81-f730-4302-9c15-3d6ca631fa5e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:23.388948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a17c81-f730-4302-9c15-3d6ca631fa5e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:23.389223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a17c81-f730-4302-9c15-3d6ca631fa5e None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:23.390773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a17c81-f730-4302-9c15-3d6ca631fa5e None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:23.392229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a17c81-f730-4302-9c15-3d6ca631fa5e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:23.393885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 214/425] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:23 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:23.399671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a17c81-f730-4302-9c15-3d6ca631fa5e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:23.400709 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2d72f-bdd4-4126-a9a0-5699d2ca271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:23.401392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2d72f-bdd4-4126-a9a0-5699d2ca271f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:23.401675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2d72f-bdd4-4126-a9a0-5699d2ca271f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:23.401952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2d72f-bdd4-4126-a9a0-5699d2ca271f None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:23.402711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2d72f-bdd4-4126-a9a0-5699d2ca271f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:23.403020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2d72f-bdd4-4126-a9a0-5699d2ca271f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:23.404499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2d72f-bdd4-4126-a9a0-5699d2ca271f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:23.423886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 212/426] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:23.428974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2d72f-bdd4-4126-a9a0-5699d2ca271f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:23.515643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:23.540720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2d72f-bdd4-4126-a9a0-5699d2ca271f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:23.551315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a17c81-f730-4302-9c15-3d6ca631fa5e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:23.563686 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:23.572013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb202285-b0e0-4f88-9121-413f85dfb612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:23.572874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb202285-b0e0-4f88-9121-413f85dfb612 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:23.573304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb202285-b0e0-4f88-9121-413f85dfb612 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:23.573754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb202285-b0e0-4f88-9121-413f85dfb612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:23.594157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d75ff-ae2b-4c1e-99bb-6b20edbb429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:23.594818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d75ff-ae2b-4c1e-99bb-6b20edbb429d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:23.595104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d75ff-ae2b-4c1e-99bb-6b20edbb429d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:23.595384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d75ff-ae2b-4c1e-99bb-6b20edbb429d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:23.596208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d75ff-ae2b-4c1e-99bb-6b20edbb429d None admin] RBAC: Adding query filter params (group.id=2959e6c2bfd740489e20378247333cd0, role.id=64789f5937034a188d1774823d2387cb, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:23.596565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d75ff-ae2b-4c1e-99bb-6b20edbb429d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:23.598517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d75ff-ae2b-4c1e-99bb-6b20edbb429d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:23.607415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 215/427] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:23 2022] GET /identity/v3/role_assignments?group.id=2959e6c2bfd740489e20378247333cd0&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=64789f5937034a188d1774823d2387cb => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:23.608899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b415d-7abf-40af-abef-8dca2f6cf53d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:23.609191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b415d-7abf-40af-abef-8dca2f6cf53d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:23.609467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b415d-7abf-40af-abef-8dca2f6cf53d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:23.616029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 216/428] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:23.618511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811c88-d270-4806-8da4-c804d455cc34 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:23.618807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811c88-d270-4806-8da4-c804d455cc34 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:23.619081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811c88-d270-4806-8da4-c804d455cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:23.640942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-96811c88-d270-4806-8da4-c804d455cc34 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:23.642691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-96811c88-d270-4806-8da4-c804d455cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:23.660126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb202285-b0e0-4f88-9121-413f85dfb612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:23.662042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb202285-b0e0-4f88-9121-413f85dfb612 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:23.734558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 217/429] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:23.760877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96811c88-d270-4806-8da4-c804d455cc34 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:23.773260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:23.827476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 213/430] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:23.832803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb202285-b0e0-4f88-9121-413f85dfb612 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:23.898240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96811c88-d270-4806-8da4-c804d455cc34 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:23.900304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:23.941935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fc392-05d4-49e0-bc08-f876b3c80c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:23.942977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc392-05d4-49e0-bc08-f876b3c80c1f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:23.943416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc392-05d4-49e0-bc08-f876b3c80c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:23.943989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc392-05d4-49e0-bc08-f876b3c80c1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:23.956850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fc392-05d4-49e0-bc08-f876b3c80c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5f0fc392-05d4-49e0-bc08-f876b3c80c1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:23.968230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:23.969359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 03:04:23.970336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:23.972847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 218/431] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:23.978872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fc392-05d4-49e0-bc08-f876b3c80c1f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.016617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb202285-b0e0-4f88-9121-413f85dfb612 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:24.054644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91713e35-8f4a-4c49-8e00-5467633cc765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:24.056464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91713e35-8f4a-4c49-8e00-5467633cc765 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.056862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91713e35-8f4a-4c49-8e00-5467633cc765 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.057293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91713e35-8f4a-4c49-8e00-5467633cc765 None admin] PATH_INFO: `/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.058624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91713e35-8f4a-4c49-8e00-5467633cc765 None admin] RBAC: Authorizing `identity:get_project(project_id=152bd9bca8fd403b8fbe6b285e7dc5a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:24.060215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91713e35-8f4a-4c49-8e00-5467633cc765 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:24.062337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 214/432] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:23 2022] GET /identity/v3/projects/152bd9bca8fd403b8fbe6b285e7dc5a4 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:24.069349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91713e35-8f4a-4c49-8e00-5467633cc765 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.105040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fc392-05d4-49e0-bc08-f876b3c80c1f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:24.130068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:24.143980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679c512-f960-49ad-b872-8b5be16cd3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:24.144887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679c512-f960-49ad-b872-8b5be16cd3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.145316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679c512-f960-49ad-b872-8b5be16cd3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.148423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679c512-f960-49ad-b872-8b5be16cd3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.148423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679c512-f960-49ad-b872-8b5be16cd3c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:24.148423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679c512-f960-49ad-b872-8b5be16cd3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:24.148423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679c512-f960-49ad-b872-8b5be16cd3c8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:24.158401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 219/433] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:04:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:24.164009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679c512-f960-49ad-b872-8b5be16cd3c8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.183396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91713e35-8f4a-4c49-8e00-5467633cc765 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:24.191045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:24.223692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914396-693b-4c20-8fe6-b91ec7ba6b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:24.224669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914396-693b-4c20-8fe6-b91ec7ba6b23 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.224870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914396-693b-4c20-8fe6-b91ec7ba6b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.225433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914396-693b-4c20-8fe6-b91ec7ba6b23 None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.226650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39914396-693b-4c20-8fe6-b91ec7ba6b23 None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:24.228106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39914396-693b-4c20-8fe6-b91ec7ba6b23 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:24.230119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 215/434] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:24 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:24.236300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914396-693b-4c20-8fe6-b91ec7ba6b23 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.272694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679c512-f960-49ad-b872-8b5be16cd3c8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:24.308948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba50b54-cc54-4e7c-8932-b441a799ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:24.310277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba50b54-cc54-4e7c-8932-b441a799ba52 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.310708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba50b54-cc54-4e7c-8932-b441a799ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.311129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba50b54-cc54-4e7c-8932-b441a799ba52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.346596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914396-693b-4c20-8fe6-b91ec7ba6b23 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:24.364480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:24.383250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2902200-538c-4aa0-bc90-64c136fb6605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:24.383969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902200-538c-4aa0-bc90-64c136fb6605 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.384289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902200-538c-4aa0-bc90-64c136fb6605 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.385675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902200-538c-4aa0-bc90-64c136fb6605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.386162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2902200-538c-4aa0-bc90-64c136fb6605 None admin] RBAC: Adding query filter params (group.id=2959e6c2bfd740489e20378247333cd0, role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:24.386488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2902200-538c-4aa0-bc90-64c136fb6605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:24.388957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2902200-538c-4aa0-bc90-64c136fb6605 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:24.393785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba50b54-cc54-4e7c-8932-b441a799ba52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:24.395608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba50b54-cc54-4e7c-8932-b441a799ba52 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:24.396455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 216/435] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:24 2022] GET /identity/v3/role_assignments?group.id=2959e6c2bfd740489e20378247333cd0&scope.project.id=152bd9bca8fd403b8fbe6b285e7dc5a4&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:24.397771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fc052-5589-4a01-bdb2-baedb1c81d0c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.398060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fc052-5589-4a01-bdb2-baedb1c81d0c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.398337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fc052-5589-4a01-bdb2-baedb1c81d0c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.400934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 217/436] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:24.409407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e6c07-78b1-423f-9350-3a3be4c280da None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.410037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e6c07-78b1-423f-9350-3a3be4c280da None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.410514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e6c07-78b1-423f-9350-3a3be4c280da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.429682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ca1e6c07-78b1-423f-9350-3a3be4c280da None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:24.430310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:24.432620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ca1e6c07-78b1-423f-9350-3a3be4c280da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:24.517148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 218/437] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:24.526092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 220/438] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:24.532286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e6c07-78b1-423f-9350-3a3be4c280da None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.544970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba50b54-cc54-4e7c-8932-b441a799ba52 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.669367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e6c07-78b1-423f-9350-3a3be4c280da None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:24.676290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba50b54-cc54-4e7c-8932-b441a799ba52 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:24.684362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:24.708484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:24.711140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e787b-952f-4a29-a325-6971658075fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:24.711995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e787b-952f-4a29-a325-6971658075fa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.712276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e787b-952f-4a29-a325-6971658075fa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.712577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e787b-952f-4a29-a325-6971658075fa None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.714037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e787b-952f-4a29-a325-6971658075fa None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:24.715467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e787b-952f-4a29-a325-6971658075fa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:24.721615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 219/439] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:24 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:24.721798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232e8fb-7092-4ead-a9f9-5d3e566bfb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:24.722580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232e8fb-7092-4ead-a9f9-5d3e566bfb2c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.722813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e787b-952f-4a29-a325-6971658075fa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.722909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232e8fb-7092-4ead-a9f9-5d3e566bfb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.723183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232e8fb-7092-4ead-a9f9-5d3e566bfb2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.736661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232e8fb-7092-4ead-a9f9-5d3e566bfb2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-0232e8fb-7092-4ead-a9f9-5d3e566bfb2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:24.744878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:24.746059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:24.746985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 221/440] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:04:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:24.752342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232e8fb-7092-4ead-a9f9-5d3e566bfb2c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.870270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e787b-952f-4a29-a325-6971658075fa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:24.883306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232e8fb-7092-4ead-a9f9-5d3e566bfb2c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:24.917450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d7b8-7bfb-4e5c-b4a8-99f58a050271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:24.918634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d7b8-7bfb-4e5c-b4a8-99f58a050271 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.918942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d7b8-7bfb-4e5c-b4a8-99f58a050271 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.919226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d7b8-7bfb-4e5c-b4a8-99f58a050271 None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.921326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52d7b8-7bfb-4e5c-b4a8-99f58a050271 None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:24.921935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52d7b8-7bfb-4e5c-b4a8-99f58a050271 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:24.923716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 220/441] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:24 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:24.930355 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d7b8-7bfb-4e5c-b4a8-99f58a050271 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.933180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e00afc-a5f1-4671-89c4-f43d810b8a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:24.935555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e00afc-a5f1-4671-89c4-f43d810b8a52 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:24.936058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e00afc-a5f1-4671-89c4-f43d810b8a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:24.939273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e00afc-a5f1-4671-89c4-f43d810b8a52 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:24.939273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e00afc-a5f1-4671-89c4-f43d810b8a52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:24.939273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e00afc-a5f1-4671-89c4-f43d810b8a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:24.939273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e00afc-a5f1-4671-89c4-f43d810b8a52 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:24.950939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 222/442] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:24.958716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e00afc-a5f1-4671-89c4-f43d810b8a52 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:24.987371 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:25.016518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:25.053071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d7b8-7bfb-4e5c-b4a8-99f58a050271 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:25.072546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e00afc-a5f1-4671-89c4-f43d810b8a52 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:25.087068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280fbb4-9edb-4b6a-b76a-c6f6b65b498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:25.087725 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280fbb4-9edb-4b6a-b76a-c6f6b65b498d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.088010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280fbb4-9edb-4b6a-b76a-c6f6b65b498d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.088580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280fbb4-9edb-4b6a-b76a-c6f6b65b498d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.089417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280fbb4-9edb-4b6a-b76a-c6f6b65b498d None admin] RBAC: Adding query filter params (group.id=2959e6c2bfd740489e20378247333cd0, role.id=64789f5937034a188d1774823d2387cb, scope.project.id=6da20a2c16864901ae4e4966a4f38536) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:25.089732 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280fbb4-9edb-4b6a-b76a-c6f6b65b498d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:25.091209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280fbb4-9edb-4b6a-b76a-c6f6b65b498d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:25.096955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 221/443] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:24 2022] GET /identity/v3/role_assignments?group.id=2959e6c2bfd740489e20378247333cd0&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=64789f5937034a188d1774823d2387cb => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:25.096955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983e63e-32d0-4705-8bfd-aa126bfbe47b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.096955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983e63e-32d0-4705-8bfd-aa126bfbe47b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.096955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983e63e-32d0-4705-8bfd-aa126bfbe47b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.096955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 222/444] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:25.105544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3bcf-04be-415b-afe2-da5e6325c2f4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.105839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3bcf-04be-415b-afe2-da5e6325c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.106043 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b419efe-5bc3-4c56-8345-6d0609157518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:25.106162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3bcf-04be-415b-afe2-da5e6325c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.107255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b419efe-5bc3-4c56-8345-6d0609157518 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.107534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b419efe-5bc3-4c56-8345-6d0609157518 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.107804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b419efe-5bc3-4c56-8345-6d0609157518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.124720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4aff3bcf-04be-415b-afe2-da5e6325c2f4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:25.125977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4aff3bcf-04be-415b-afe2-da5e6325c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:25.188244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b419efe-5bc3-4c56-8345-6d0609157518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:25.189676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b419efe-5bc3-4c56-8345-6d0609157518 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:25.204618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 223/445] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:25.228772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff3bcf-04be-415b-afe2-da5e6325c2f4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:25.240958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:25.276200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:25.308274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 223/446] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:25.314594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b419efe-5bc3-4c56-8345-6d0609157518 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:25.339710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff3bcf-04be-415b-afe2-da5e6325c2f4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:25.387693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e2a76-7509-4077-a674-3d5cad8c978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:25.388549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e2a76-7509-4077-a674-3d5cad8c978b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.388833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e2a76-7509-4077-a674-3d5cad8c978b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.389108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e2a76-7509-4077-a674-3d5cad8c978b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.405980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e2a76-7509-4077-a674-3d5cad8c978b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a98e2a76-7509-4077-a674-3d5cad8c978b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:25.413745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:25.414677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:25.415488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 224/447] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:25.422656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e2a76-7509-4077-a674-3d5cad8c978b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:25.433370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b419efe-5bc3-4c56-8345-6d0609157518 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:25.473566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01287d0-2c52-492d-83d3-73e2537bbe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:25.474342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01287d0-2c52-492d-83d3-73e2537bbe7c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.474627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01287d0-2c52-492d-83d3-73e2537bbe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.474904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01287d0-2c52-492d-83d3-73e2537bbe7c None admin] PATH_INFO: `/v3/projects/6da20a2c16864901ae4e4966a4f38536` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.476102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01287d0-2c52-492d-83d3-73e2537bbe7c None admin] RBAC: Authorizing `identity:get_project(project_id=6da20a2c16864901ae4e4966a4f38536)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:25.477625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01287d0-2c52-492d-83d3-73e2537bbe7c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:25.479568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 224/448] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:25 2022] GET /identity/v3/projects/6da20a2c16864901ae4e4966a4f38536 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:25.485819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01287d0-2c52-492d-83d3-73e2537bbe7c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:25.501938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:25.533895 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e2a76-7509-4077-a674-3d5cad8c978b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:25.535517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:25.567153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500e09-55db-49b9-958a-dbae17a49bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:25.567825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500e09-55db-49b9-958a-dbae17a49bff None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.568152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500e09-55db-49b9-958a-dbae17a49bff None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.568844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500e09-55db-49b9-958a-dbae17a49bff None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.569782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500e09-55db-49b9-958a-dbae17a49bff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:25.570416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500e09-55db-49b9-958a-dbae17a49bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:25.572147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500e09-55db-49b9-958a-dbae17a49bff None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:25.579994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 225/449] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:25.583655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01287d0-2c52-492d-83d3-73e2537bbe7c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:25.585449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500e09-55db-49b9-958a-dbae17a49bff None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:25.618367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6512f-3d10-47f7-ab0a-044b5a1c0856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:25.619224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6512f-3d10-47f7-ab0a-044b5a1c0856 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.619512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6512f-3d10-47f7-ab0a-044b5a1c0856 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.619788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6512f-3d10-47f7-ab0a-044b5a1c0856 None admin] PATH_INFO: `/v3/groups/2959e6c2bfd740489e20378247333cd0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.620977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6512f-3d10-47f7-ab0a-044b5a1c0856 None admin] RBAC: Authorizing `identity:get_group(group_id=2959e6c2bfd740489e20378247333cd0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:25.622441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6512f-3d10-47f7-ab0a-044b5a1c0856 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:25.624040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 225/450] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:25 2022] GET /identity/v3/groups/2959e6c2bfd740489e20378247333cd0 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:25.629571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6512f-3d10-47f7-ab0a-044b5a1c0856 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:25.685047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500e09-55db-49b9-958a-dbae17a49bff None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:25.708563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:25.718830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6736eee-8b53-4968-82a1-5154ec696f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:25.719478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6736eee-8b53-4968-82a1-5154ec696f1d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.719766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6736eee-8b53-4968-82a1-5154ec696f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.720045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6736eee-8b53-4968-82a1-5154ec696f1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.727038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6512f-3d10-47f7-ab0a-044b5a1c0856 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:25.749756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:25.759913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4d411-aa76-412d-a02d-fb246a4eedb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:25.761539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4d411-aa76-412d-a02d-fb246a4eedb1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:25.761539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4d411-aa76-412d-a02d-fb246a4eedb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:25.761539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4d411-aa76-412d-a02d-fb246a4eedb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:25.761911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4d411-aa76-412d-a02d-fb246a4eedb1 None admin] RBAC: Adding query filter params (group.id=2959e6c2bfd740489e20378247333cd0, role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=6da20a2c16864901ae4e4966a4f38536) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:25.762219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4d411-aa76-412d-a02d-fb246a4eedb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:25.764246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4d411-aa76-412d-a02d-fb246a4eedb1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:25.769902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 226/451] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:25 2022] GET /identity/v3/role_assignments?group.id=2959e6c2bfd740489e20378247333cd0&scope.project.id=6da20a2c16864901ae4e4966a4f38536&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:25.789572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6736eee-8b53-4968-82a1-5154ec696f1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:25.791090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6736eee-8b53-4968-82a1-5154ec696f1d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:25.895181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 226/452] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 03:04:25.901025 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4d411-aa76-412d-a02d-fb246a4eedb1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:26.002141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4d411-aa76-412d-a02d-fb246a4eedb1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:26.037646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149fd7b-56a9-4a34-ad8d-6abf00372a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:26.038508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149fd7b-56a9-4a34-ad8d-6abf00372a26 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:26.038791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149fd7b-56a9-4a34-ad8d-6abf00372a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:26.039067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149fd7b-56a9-4a34-ad8d-6abf00372a26 None admin] PATH_INFO: `/v3/projects/2bc9d186e27441d983463d38b1cc22e5` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:26.040242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149fd7b-56a9-4a34-ad8d-6abf00372a26 None admin] RBAC: Authorizing `identity:get_project(project_id=2bc9d186e27441d983463d38b1cc22e5)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:26.041713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149fd7b-56a9-4a34-ad8d-6abf00372a26 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:26.043687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 227/453] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:04:25 2022] GET /identity/v3/projects/2bc9d186e27441d983463d38b1cc22e5 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:26.049217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6736eee-8b53-4968-82a1-5154ec696f1d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:26.113695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:26.150825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6736eee-8b53-4968-82a1-5154ec696f1d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:26.183338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e1e0d-6edb-4948-a3bf-65093bc569b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:26.184181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1e0d-6edb-4948-a3bf-65093bc569b4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:26.185023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1e0d-6edb-4948-a3bf-65093bc569b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:26.185303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1e0d-6edb-4948-a3bf-65093bc569b4 None admin] PATH_INFO: `/v3/groups/bd8e0f6834194ef5a8840d6638cea02c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:26.186460 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e1e0d-6edb-4948-a3bf-65093bc569b4 None admin] RBAC: Authorizing `identity:get_group(group_id=bd8e0f6834194ef5a8840d6638cea02c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:26.187902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e1e0d-6edb-4948-a3bf-65093bc569b4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:26.189531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 227/454] 10.222.0.15 () {56 vars in 1180 bytes} [Thu May 26 03:04:26 2022] GET /identity/v3/groups/bd8e0f6834194ef5a8840d6638cea02c => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:26.195293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149fd7b-56a9-4a34-ad8d-6abf00372a26 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:26.211655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:26.292741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149fd7b-56a9-4a34-ad8d-6abf00372a26 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:26.324433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fddbf-9415-4cef-8cb2-6a758e56b8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:26.325110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fddbf-9415-4cef-8cb2-6a758e56b8ef None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:26.325929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fddbf-9415-4cef-8cb2-6a758e56b8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:26.326207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fddbf-9415-4cef-8cb2-6a758e56b8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:26.327020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fddbf-9415-4cef-8cb2-6a758e56b8ef None admin] RBAC: Adding query filter params (group.id=bd8e0f6834194ef5a8840d6638cea02c, role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=2bc9d186e27441d983463d38b1cc22e5) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:26.327339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fddbf-9415-4cef-8cb2-6a758e56b8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:26.328785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fddbf-9415-4cef-8cb2-6a758e56b8ef None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:26.334346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 228/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu May 26 03:04:26 2022] GET /identity/v3/role_assignments?group.id=bd8e0f6834194ef5a8840d6638cea02c&scope.project.id=2bc9d186e27441d983463d38b1cc22e5&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:28.879399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a125c-a302-45e9-923c-158dcd5a1cdd None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:28.880383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a125c-a302-45e9-923c-158dcd5a1cdd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:28.880856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a125c-a302-45e9-923c-158dcd5a1cdd None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:28.882783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 228/456] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:28.888006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86b33-2208-4dcd-94dd-4fc1748d3a75 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:28.888455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86b33-2208-4dcd-94dd-4fc1748d3a75 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:28.888590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86b33-2208-4dcd-94dd-4fc1748d3a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:28.913545 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7aa86b33-2208-4dcd-94dd-4fc1748d3a75 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:28.914984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7aa86b33-2208-4dcd-94dd-4fc1748d3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:29.013061 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 229/457] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:29.044732 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420abaf1-0640-413f-a9e5-cf187b7fa577 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.045345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420abaf1-0640-413f-a9e5-cf187b7fa577 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.045816 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420abaf1-0640-413f-a9e5-cf187b7fa577 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.047635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 229/458] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:29.052179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86b33-2208-4dcd-94dd-4fc1748d3a75 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:29.053157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bd1a3-15eb-471e-a20a-9fdde6e961c1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.053643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bd1a3-15eb-471e-a20a-9fdde6e961c1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.054130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bd1a3-15eb-471e-a20a-9fdde6e961c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.064991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:29.081853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-051bd1a3-15eb-471e-a20a-9fdde6e961c1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:29.083048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-051bd1a3-15eb-471e-a20a-9fdde6e961c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:29.193719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 230/459] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:29.230043 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86b33-2208-4dcd-94dd-4fc1748d3a75 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:29.254921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bd1a3-15eb-471e-a20a-9fdde6e961c1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:29.271846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862d40-30cd-45a2-adad-c3a840e799ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:29.272679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862d40-30cd-45a2-adad-c3a840e799ba None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.272962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862d40-30cd-45a2-adad-c3a840e799ba None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.273238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862d40-30cd-45a2-adad-c3a840e799ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.286436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3862d40-30cd-45a2-adad-c3a840e799ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:29.288161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3862d40-30cd-45a2-adad-c3a840e799ba None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-d3862d40-30cd-45a2-adad-c3a840e799ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:29.327272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:29.328180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:29.329067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:29.329067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:29.329067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:29.329067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:29.339494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 230/460] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:29.345339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862d40-30cd-45a2-adad-c3a840e799ba None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:29.372667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:29.434527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bd1a3-15eb-471e-a20a-9fdde6e961c1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:29.462086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:29.494615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eac97e-ab21-4035-ba5b-93af7c4845f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:29.495647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac97e-ab21-4035-ba5b-93af7c4845f7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.496063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac97e-ab21-4035-ba5b-93af7c4845f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.496498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac97e-ab21-4035-ba5b-93af7c4845f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.507923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eac97e-ab21-4035-ba5b-93af7c4845f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:29.509652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eac97e-ab21-4035-ba5b-93af7c4845f7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-35eac97e-ab21-4035-ba5b-93af7c4845f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:29.531079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:29.531982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:29.532891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:29.532891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:29.532891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:29.532891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:29.535080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 231/461] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:29.536672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d7071-d7ff-42e2-8cf8-5c7debadee1f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.537182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d7071-d7ff-42e2-8cf8-5c7debadee1f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.537659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d7071-d7ff-42e2-8cf8-5c7debadee1f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.539202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862d40-30cd-45a2-adad-c3a840e799ba None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:29.539465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 232/462] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:29.540265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d7071-d7ff-42e2-8cf8-5c7debadee1f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:29.577464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc83cd-2b73-4fe2-9a9b-dff441ded390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:29.578469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc83cd-2b73-4fe2-9a9b-dff441ded390 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.578847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc83cd-2b73-4fe2-9a9b-dff441ded390 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.579242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc83cd-2b73-4fe2-9a9b-dff441ded390 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.580059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc83cd-2b73-4fe2-9a9b-dff441ded390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:29.580598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc83cd-2b73-4fe2-9a9b-dff441ded390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:29.582287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc83cd-2b73-4fe2-9a9b-dff441ded390 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:29.596817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 231/463] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:29.598555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e8a0c-1fa4-468c-8752-be83c797f193 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.599064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e8a0c-1fa4-468c-8752-be83c797f193 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.599532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e8a0c-1fa4-468c-8752-be83c797f193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.616961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ac4e8a0c-1fa4-468c-8752-be83c797f193 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:29.618628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ac4e8a0c-1fa4-468c-8752-be83c797f193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:29.649860 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d7071-d7ff-42e2-8cf8-5c7debadee1f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:29.665123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:29.684999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ec3d7-59dc-4c09-9784-5dcaf88edde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:29.685672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ec3d7-59dc-4c09-9784-5dcaf88edde0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.685954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ec3d7-59dc-4c09-9784-5dcaf88edde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.686231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ec3d7-59dc-4c09-9784-5dcaf88edde0 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.686956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ec3d7-59dc-4c09-9784-5dcaf88edde0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:29.687262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ec3d7-59dc-4c09-9784-5dcaf88edde0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:29.688662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ec3d7-59dc-4c09-9784-5dcaf88edde0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:29.694598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 232/464] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:29.697879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e8a0c-1fa4-468c-8752-be83c797f193 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:29.701351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 233/465] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:29.702867 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a3c6-0d0f-4691-930a-da36f12252ed None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.703303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a3c6-0d0f-4691-930a-da36f12252ed None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.703726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a3c6-0d0f-4691-930a-da36f12252ed None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.705398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 234/466] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:29.707062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823a3c6-0d0f-4691-930a-da36f12252ed None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:29.757694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:29.807308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e8a0c-1fa4-468c-8752-be83c797f193 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:29.824283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823a3c6-0d0f-4691-930a-da36f12252ed None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:29.844237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ec85e-12e3-4c26-9bf3-887e01eed07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:29.844874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ec85e-12e3-4c26-9bf3-887e01eed07c None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.845160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ec85e-12e3-4c26-9bf3-887e01eed07c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.845429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ec85e-12e3-4c26-9bf3-887e01eed07c None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.846131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ec85e-12e3-4c26-9bf3-887e01eed07c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:29.847571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ec85e-12e3-4c26-9bf3-887e01eed07c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:29.864231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eb5a7-316e-46b7-bc3f-ac9670ee29b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:29.864946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eb5a7-316e-46b7-bc3f-ac9670ee29b5 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.865232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eb5a7-316e-46b7-bc3f-ac9670ee29b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.881970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eb5a7-316e-46b7-bc3f-ac9670ee29b5 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.881970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eb5a7-316e-46b7-bc3f-ac9670ee29b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:29.881970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eb5a7-316e-46b7-bc3f-ac9670ee29b5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:29.969521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 233/467] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:04:29 2022] POST /identity/v3/users => generated 246 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:04:29.970780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f62933-e52e-488a-9e85-f26fb18b1a01 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:29.971072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f62933-e52e-488a-9e85-f26fb18b1a01 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:29.971350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f62933-e52e-488a-9e85-f26fb18b1a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:29.989367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b0f62933-e52e-488a-9e85-f26fb18b1a01 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:29.990612 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b0f62933-e52e-488a-9e85-f26fb18b1a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:30.001726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 235/468] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:04:29 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:04:30.003640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eb5a7-316e-46b7-bc3f-ac9670ee29b5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:30.045285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:30.091149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 234/469] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:30.151657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f62933-e52e-488a-9e85-f26fb18b1a01 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:30.159808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eb5a7-316e-46b7-bc3f-ac9670ee29b5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:30.211684 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:30.237580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cf510-433a-47fa-8cd2-930cb5a6316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:30.238571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cf510-433a-47fa-8cd2-930cb5a6316e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:30.238864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cf510-433a-47fa-8cd2-930cb5a6316e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:30.239150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cf510-433a-47fa-8cd2-930cb5a6316e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:30.254562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cf510-433a-47fa-8cd2-930cb5a6316e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:30.258069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cf510-433a-47fa-8cd2-930cb5a6316e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-083cf510-433a-47fa-8cd2-930cb5a6316e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:30.286917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:30.287993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:30.288911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:30.288911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:30.288911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:30.288911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:30.288911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 236/470] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:30.295967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cf510-433a-47fa-8cd2-930cb5a6316e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:30.305112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f62933-e52e-488a-9e85-f26fb18b1a01 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:30.344281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655f565-9e5c-4ec9-b859-c840bdd05358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:30.345111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655f565-9e5c-4ec9-b859-c840bdd05358 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:30.345396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655f565-9e5c-4ec9-b859-c840bdd05358 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:30.345674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655f565-9e5c-4ec9-b859-c840bdd05358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:30.357307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655f565-9e5c-4ec9-b859-c840bdd05358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:30.358789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655f565-9e5c-4ec9-b859-c840bdd05358 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-4655f565-9e5c-4ec9-b859-c840bdd05358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:30.382273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:30.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:30.384072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:30.384072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:30.384072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:30.384072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:30.384072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 235/471] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:30.392888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655f565-9e5c-4ec9-b859-c840bdd05358 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:30.409043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:30.438409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cf510-433a-47fa-8cd2-930cb5a6316e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:30.483779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3603f2-ce04-4504-8afe-e4b56b25d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:30.484480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3603f2-ce04-4504-8afe-e4b56b25d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:30.484769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3603f2-ce04-4504-8afe-e4b56b25d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:30.485102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3603f2-ce04-4504-8afe-e4b56b25d0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:30.486123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3603f2-ce04-4504-8afe-e4b56b25d0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:30.486491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3603f2-ce04-4504-8afe-e4b56b25d0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:30.488169 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3603f2-ce04-4504-8afe-e4b56b25d0d8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:30.504386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 237/472] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:30.509166 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3603f2-ce04-4504-8afe-e4b56b25d0d8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:30.511785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:30.528799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655f565-9e5c-4ec9-b859-c840bdd05358 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:30.600224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c35a3-2bd3-4cc6-99df-ce8ace9722c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:30.601412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c35a3-2bd3-4cc6-99df-ce8ace9722c8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:30.601898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c35a3-2bd3-4cc6-99df-ce8ace9722c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:30.602392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c35a3-2bd3-4cc6-99df-ce8ace9722c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:30.603417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c35a3-2bd3-4cc6-99df-ce8ace9722c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:30.604280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c35a3-2bd3-4cc6-99df-ce8ace9722c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:30.607812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c35a3-2bd3-4cc6-99df-ce8ace9722c8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:30.628361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3603f2-ce04-4504-8afe-e4b56b25d0d8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:30.633954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 236/473] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:30.640260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c35a3-2bd3-4cc6-99df-ce8ace9722c8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:30.670248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae5dfc-4c81-45f3-8e6a-939a50df61c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:30.670843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae5dfc-4c81-45f3-8e6a-939a50df61c0 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:30.671128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae5dfc-4c81-45f3-8e6a-939a50df61c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:30.671407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae5dfc-4c81-45f3-8e6a-939a50df61c0 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:30.672412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae5dfc-4c81-45f3-8e6a-939a50df61c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:30.674560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae5dfc-4c81-45f3-8e6a-939a50df61c0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:30.758025 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c35a3-2bd3-4cc6-99df-ce8ace9722c8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:30.782176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:30.803537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 238/474] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:04:30 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:04:30.803537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665cb9-ee73-4873-bede-05122fd6da47 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:30.803537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665cb9-ee73-4873-bede-05122fd6da47 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:30.803537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665cb9-ee73-4873-bede-05122fd6da47 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:30.803537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 239/475] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:30.806291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e7e70-3fae-4fea-a621-26bdb70e980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:30.806979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e7e70-3fae-4fea-a621-26bdb70e980c None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:30.807748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e7e70-3fae-4fea-a621-26bdb70e980c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:30.807748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e7e70-3fae-4fea-a621-26bdb70e980c None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:30.808352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e7e70-3fae-4fea-a621-26bdb70e980c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:30.809999 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e7e70-3fae-4fea-a621-26bdb70e980c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:30.811651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4411e-4370-44c7-a9e9-ed7416afbe71 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:30.811969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4411e-4370-44c7-a9e9-ed7416afbe71 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:30.812201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4411e-4370-44c7-a9e9-ed7416afbe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:30.839461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b6b4411e-4370-44c7-a9e9-ed7416afbe71 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:30.841315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b6b4411e-4370-44c7-a9e9-ed7416afbe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:30.920765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 240/476] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:30.942946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4411e-4370-44c7-a9e9-ed7416afbe71 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:30.964425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 237/477] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:04:30 2022] POST /identity/v3/users => generated 249 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:04:31.070740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4411e-4370-44c7-a9e9-ed7416afbe71 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:31.103182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:31.115093 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:31.115850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:31.116194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:31.116510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:31.117289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:31.118721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:31.164630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.sql.core [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 03:04:31.164630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 03:04:31.164630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [parameters: {'id': '0f1706dd638141f6a5073861ba8269ad', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 03:04:31.164630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80614) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = self._query(query) May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application conn.query(q) May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result.read() May 26 03:04:31.183574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return ref.to_dict() May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 03:04:31.184635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application next(self.gen) May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application yield resource May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application next(self.gen) May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.session.rollback() May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.force_reraise() May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise self.value May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application session.commit() May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 03:04:31.185666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._prepare_impl() May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.session.flush() May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._flush(objects) May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application compat.raise_( May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application flush_context.execute() May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rec.execute(self) May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 03:04:31.186772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 03:04:31.187685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = self._query(query) May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application conn.query(q) May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result.read() May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 03:04:31.188563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [parameters: {'id': '0f1706dd638141f6a5073861ba8269ad', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:31.189393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 03:04:31.190447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:31.191461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 241/478] 10.222.0.15 () {60 vars in 1131 bytes} [Thu May 26 03:04:30 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:31.196336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e7e70-3fae-4fea-a621-26bdb70e980c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:31.198231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:31.308171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e7e70-3fae-4fea-a621-26bdb70e980c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:31.344422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b11bc-dbb5-4985-a54b-3a0938f321a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:31.345266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b11bc-dbb5-4985-a54b-3a0938f321a9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:31.345547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b11bc-dbb5-4985-a54b-3a0938f321a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:31.345820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b11bc-dbb5-4985-a54b-3a0938f321a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:31.357696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b11bc-dbb5-4985-a54b-3a0938f321a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-088b11bc-dbb5-4985-a54b-3a0938f321a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:31.365761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:31.367717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:31.368943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 238/479] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:04:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:31.373568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:31.492472 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19991ea-85d9-490a-8b96-4a05e2450172 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:31.528456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54597777-10cb-40c7-9a92-53905a52e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:31.529468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54597777-10cb-40c7-9a92-53905a52e755 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:31.529974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54597777-10cb-40c7-9a92-53905a52e755 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:31.530447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54597777-10cb-40c7-9a92-53905a52e755 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:31.531388 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54597777-10cb-40c7-9a92-53905a52e755 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:31.531896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54597777-10cb-40c7-9a92-53905a52e755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:31.533524 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54597777-10cb-40c7-9a92-53905a52e755 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:31.546309 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 242/480] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:32.607978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6fdb-32a5-431a-a0d1-92e930f5290c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:32.608518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6fdb-32a5-431a-a0d1-92e930f5290c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:32.608593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6fdb-32a5-431a-a0d1-92e930f5290c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:32.610156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 239/481] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:32.615349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1a8ed-d848-4108-9551-bef7afd2b2da None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:32.615732 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1a8ed-d848-4108-9551-bef7afd2b2da None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:32.615897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1a8ed-d848-4108-9551-bef7afd2b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:32.641296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9dd1a8ed-d848-4108-9551-bef7afd2b2da None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:32.642518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9dd1a8ed-d848-4108-9551-bef7afd2b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:32.711045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:32.734417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 243/482] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:32.737860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927efa80-3767-461f-8d24-1904de6ae590 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:32.738149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927efa80-3767-461f-8d24-1904de6ae590 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:32.738423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927efa80-3767-461f-8d24-1904de6ae590 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:32.739899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 240/483] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:32.745090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377076d-1a18-4df4-bcc8-e842660c1337 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:32.745380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377076d-1a18-4df4-bcc8-e842660c1337 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:32.745656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377076d-1a18-4df4-bcc8-e842660c1337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:32.763980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927efa80-3767-461f-8d24-1904de6ae590 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:32.765685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e377076d-1a18-4df4-bcc8-e842660c1337 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:32.766846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e377076d-1a18-4df4-bcc8-e842660c1337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:32.867416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:32.889573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 244/484] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:32.914978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377076d-1a18-4df4-bcc8-e842660c1337 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:32.977114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927efa80-3767-461f-8d24-1904de6ae590 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:33.047703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c3ff5-ad09-4321-8e3e-56f1ac9ef73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:33.048535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c3ff5-ad09-4321-8e3e-56f1ac9ef73a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.048821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c3ff5-ad09-4321-8e3e-56f1ac9ef73a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.049097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c3ff5-ad09-4321-8e3e-56f1ac9ef73a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.074239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c3ff5-ad09-4321-8e3e-56f1ac9ef73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:33.091361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377076d-1a18-4df4-bcc8-e842660c1337 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6c2c3ff5-ad09-4321-8e3e-56f1ac9ef73a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:33.093651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:33.094626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:33.095435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 241/485] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:33.102151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c3ff5-ad09-4321-8e3e-56f1ac9ef73a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:33.132766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:33.171051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d575a4-ebd2-4205-950e-e34763e56e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:33.171912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d575a4-ebd2-4205-950e-e34763e56e06 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.172200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d575a4-ebd2-4205-950e-e34763e56e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.172504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d575a4-ebd2-4205-950e-e34763e56e06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.195096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d575a4-ebd2-4205-950e-e34763e56e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-60d575a4-ebd2-4205-950e-e34763e56e06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:33.210685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:33.211609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:33.212441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:33.217654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 245/486] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:33.220412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d575a4-ebd2-4205-950e-e34763e56e06 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:33.307388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c3ff5-ad09-4321-8e3e-56f1ac9ef73a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:33.351947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d575a4-ebd2-4205-950e-e34763e56e06 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:33.361753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:33.393238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacc320-ebf7-4eab-8957-a9decf99a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:33.393850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacc320-ebf7-4eab-8957-a9decf99a679 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.394137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacc320-ebf7-4eab-8957-a9decf99a679 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.394421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacc320-ebf7-4eab-8957-a9decf99a679 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.394584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292efb8-b088-4e97-9b23-3bd0fff57a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:33.395200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacc320-ebf7-4eab-8957-a9decf99a679 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:33.395513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacc320-ebf7-4eab-8957-a9decf99a679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:33.395733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292efb8-b088-4e97-9b23-3bd0fff57a8d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.396155 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292efb8-b088-4e97-9b23-3bd0fff57a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.396607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292efb8-b088-4e97-9b23-3bd0fff57a8d None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.396983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacc320-ebf7-4eab-8957-a9decf99a679 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:33.397680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292efb8-b088-4e97-9b23-3bd0fff57a8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:33.398200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292efb8-b088-4e97-9b23-3bd0fff57a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:33.400104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292efb8-b088-4e97-9b23-3bd0fff57a8d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:33.412477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 246/487] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:33.418055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292efb8-b088-4e97-9b23-3bd0fff57a8d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:33.418957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 242/488] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:33.423884 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacc320-ebf7-4eab-8957-a9decf99a679 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:33.471283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:33.527485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292efb8-b088-4e97-9b23-3bd0fff57a8d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:33.562738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbc301-aef6-4e30-b2c6-28beafccbf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:33.563539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbc301-aef6-4e30-b2c6-28beafccbf82 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.563830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbc301-aef6-4e30-b2c6-28beafccbf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.564112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbc301-aef6-4e30-b2c6-28beafccbf82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.575942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbc301-aef6-4e30-b2c6-28beafccbf82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:33.577595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbc301-aef6-4e30-b2c6-28beafccbf82 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7fdbc301-aef6-4e30-b2c6-28beafccbf82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:33.598010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:33.598938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:33.599807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:33.599807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:33.599807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:33.599807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:33.599807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 247/489] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:33.605541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbc301-aef6-4e30-b2c6-28beafccbf82 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:33.681823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacc320-ebf7-4eab-8957-a9decf99a679 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:33.700706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:33.713471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbc301-aef6-4e30-b2c6-28beafccbf82 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:33.718701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72364a9-33de-4df5-b88e-2d39d5ad9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:33.737796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72364a9-33de-4df5-b88e-2d39d5ad9144 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.737796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72364a9-33de-4df5-b88e-2d39d5ad9144 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.737796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72364a9-33de-4df5-b88e-2d39d5ad9144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.737796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72364a9-33de-4df5-b88e-2d39d5ad9144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:33.737796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72364a9-33de-4df5-b88e-2d39d5ad9144 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:33.750017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba601be9-27bc-4cad-a332-e278a3d428b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:33.750757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601be9-27bc-4cad-a332-e278a3d428b6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.751156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601be9-27bc-4cad-a332-e278a3d428b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.751511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601be9-27bc-4cad-a332-e278a3d428b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c72364a9-33de-4df5-b88e-2d39d5ad9144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:33.751688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:33.752688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:33.753732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:33.753732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:33.753732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:33.753732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:33.754048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba601be9-27bc-4cad-a332-e278a3d428b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:33.754352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba601be9-27bc-4cad-a332-e278a3d428b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:33.755861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba601be9-27bc-4cad-a332-e278a3d428b6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:33.756098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 243/490] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:33.757600 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ec996-5088-4962-ab89-edbeae09a142 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.758077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ec996-5088-4962-ab89-edbeae09a142 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.758538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ec996-5088-4962-ab89-edbeae09a142 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.760211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 244/491] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:33.761129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ec996-5088-4962-ab89-edbeae09a142 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:33.771014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 248/492] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:33.772266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc41d9f-e351-4404-91b5-b749444e8ee6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.772666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc41d9f-e351-4404-91b5-b749444e8ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.772949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc41d9f-e351-4404-91b5-b749444e8ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.789728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fcc41d9f-e351-4404-91b5-b749444e8ee6 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:33.790918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fcc41d9f-e351-4404-91b5-b749444e8ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:33.817887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:33.866775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 249/493] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:33.867627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc41d9f-e351-4404-91b5-b749444e8ee6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:33.927027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ec996-5088-4962-ab89-edbeae09a142 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:33.962194 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062757db-7c15-4d56-9207-5694a2ce1a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:33.962777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062757db-7c15-4d56-9207-5694a2ce1a69 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.963312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062757db-7c15-4d56-9207-5694a2ce1a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.963588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062757db-7c15-4d56-9207-5694a2ce1a69 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.964298 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062757db-7c15-4d56-9207-5694a2ce1a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:33.964631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062757db-7c15-4d56-9207-5694a2ce1a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:33.965986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062757db-7c15-4d56-9207-5694a2ce1a69 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:33.973396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:33.978261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 245/494] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:33.979846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c3ad-665b-4af4-8540-6141ffd263c7 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:33.980384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c3ad-665b-4af4-8540-6141ffd263c7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:33.980860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c3ad-665b-4af4-8540-6141ffd263c7 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:33.982463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 246/495] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:33.983173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4c3ad-665b-4af4-8540-6141ffd263c7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.005693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc41d9f-e351-4404-91b5-b749444e8ee6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.041905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4ce0c-002a-4261-b3ae-e1e43c57e6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.042693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4ce0c-002a-4261-b3ae-e1e43c57e6eb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.042973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4ce0c-002a-4261-b3ae-e1e43c57e6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.043250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4ce0c-002a-4261-b3ae-e1e43c57e6eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.051221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4ce0c-002a-4261-b3ae-e1e43c57e6eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:34.052712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4ce0c-002a-4261-b3ae-e1e43c57e6eb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-42a4ce0c-002a-4261-b3ae-e1e43c57e6eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:34.069716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:34.070668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:34.071580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 250/496] 10.222.0.15 () {56 vars in 1093 bytes} [Thu May 26 03:04:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:34.072138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4ce0c-002a-4261-b3ae-e1e43c57e6eb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.092471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:34.097382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4c3ad-665b-4af4-8540-6141ffd263c7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.132833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e00f3-3246-4663-9d4e-38b46efc6ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.133657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e00f3-3246-4663-9d4e-38b46efc6ded None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.134348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e00f3-3246-4663-9d4e-38b46efc6ded None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.134905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e00f3-3246-4663-9d4e-38b46efc6ded None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.146566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e00f3-3246-4663-9d4e-38b46efc6ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-014e00f3-3246-4663-9d4e-38b46efc6ded None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:34.154832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:34.155715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:34.157258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 247/497] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:34.157919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81944e7c-1a19-4157-a290-828421392402 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.157919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81944e7c-1a19-4157-a290-828421392402 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.157919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81944e7c-1a19-4157-a290-828421392402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.175729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-81944e7c-1a19-4157-a290-828421392402 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:34.176872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4ce0c-002a-4261-b3ae-e1e43c57e6eb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.177016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-81944e7c-1a19-4157-a290-828421392402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:34.213866 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985586e-69d9-41ed-8857-1dae134d36a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.214609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985586e-69d9-41ed-8857-1dae134d36a1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.214891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985586e-69d9-41ed-8857-1dae134d36a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.215763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985586e-69d9-41ed-8857-1dae134d36a1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.222532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985586e-69d9-41ed-8857-1dae134d36a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:34.224144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985586e-69d9-41ed-8857-1dae134d36a1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:34.225802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d985586e-69d9-41ed-8857-1dae134d36a1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:34.239874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:34.240804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:34.241763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 251/498] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:34.242334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985586e-69d9-41ed-8857-1dae134d36a1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.264334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 248/499] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:34.264334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81944e7c-1a19-4157-a290-828421392402 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.352653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:34.359565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985586e-69d9-41ed-8857-1dae134d36a1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.366632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81944e7c-1a19-4157-a290-828421392402 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.395482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1352a76-34f3-4851-bdd1-dbc502b6316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.396152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352a76-34f3-4851-bdd1-dbc502b6316a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.396466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352a76-34f3-4851-bdd1-dbc502b6316a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.396741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352a76-34f3-4851-bdd1-dbc502b6316a None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.397572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352a76-34f3-4851-bdd1-dbc502b6316a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:34.397889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352a76-34f3-4851-bdd1-dbc502b6316a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:34.399319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352a76-34f3-4851-bdd1-dbc502b6316a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:34.402766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7afe87-d4f1-4448-814c-ad39b9402b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.403983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7afe87-d4f1-4448-814c-ad39b9402b41 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.404266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7afe87-d4f1-4448-814c-ad39b9402b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.404565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7afe87-d4f1-4448-814c-ad39b9402b41 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.405298 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7afe87-d4f1-4448-814c-ad39b9402b41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:34.405602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7afe87-d4f1-4448-814c-ad39b9402b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:34.406952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7afe87-d4f1-4448-814c-ad39b9402b41 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:34.419907 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 249/500] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:34.419907 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7afe87-d4f1-4448-814c-ad39b9402b41 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.445832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 252/501] 10.222.0.15 () {56 vars in 1133 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:34.445832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1352a76-34f3-4851-bdd1-dbc502b6316a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.498612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:34.528458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7afe87-d4f1-4448-814c-ad39b9402b41 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.541239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1352a76-34f3-4851-bdd1-dbc502b6316a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.562337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad246a-6d69-4d24-a60e-07eb428dba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.563114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad246a-6d69-4d24-a60e-07eb428dba08 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.563396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad246a-6d69-4d24-a60e-07eb428dba08 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.563667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad246a-6d69-4d24-a60e-07eb428dba08 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.564527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad246a-6d69-4d24-a60e-07eb428dba08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:34.564833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad246a-6d69-4d24-a60e-07eb428dba08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:34.566235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad246a-6d69-4d24-a60e-07eb428dba08 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:34.575799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710fed3-0853-478a-aa98-3fb8c39f8f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.576615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710fed3-0853-478a-aa98-3fb8c39f8f60 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.576899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710fed3-0853-478a-aa98-3fb8c39f8f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.577180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710fed3-0853-478a-aa98-3fb8c39f8f60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.586899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710fed3-0853-478a-aa98-3fb8c39f8f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a710fed3-0853-478a-aa98-3fb8c39f8f60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:34.595320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:34.596382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:34.597215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 253/502] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:34.597939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710fed3-0853-478a-aa98-3fb8c39f8f60 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.604059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 250/503] 10.222.0.15 () {56 vars in 1137 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:34.604790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad246a-6d69-4d24-a60e-07eb428dba08 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.615370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:34.700207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad246a-6d69-4d24-a60e-07eb428dba08 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.703886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710fed3-0853-478a-aa98-3fb8c39f8f60 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.721572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:34.733939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e33b6-26ec-46b6-8f50-a47e57f4787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.734579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e33b6-26ec-46b6-8f50-a47e57f4787f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.734859 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e33b6-26ec-46b6-8f50-a47e57f4787f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.735130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e33b6-26ec-46b6-8f50-a47e57f4787f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.738962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619f22-9682-45d8-9acb-928fd320ae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.739731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619f22-9682-45d8-9acb-928fd320ae3b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.740013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619f22-9682-45d8-9acb-928fd320ae3b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.740288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619f22-9682-45d8-9acb-928fd320ae3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.750405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19619f22-9682-45d8-9acb-928fd320ae3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:34.751804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19619f22-9682-45d8-9acb-928fd320ae3b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-19619f22-9682-45d8-9acb-928fd320ae3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:34.769375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:34.770366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:34.775690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:34.775690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:34.775690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:34.775690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:34.775690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 254/504] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:34.775690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a5c1-a23a-4e56-a668-069ab65b9aa5 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.775690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a5c1-a23a-4e56-a668-069ab65b9aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.775690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a5c1-a23a-4e56-a668-069ab65b9aa5 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.775690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 255/505] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:34.776170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48a5c1-a23a-4e56-a668-069ab65b9aa5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.808279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e33b6-26ec-46b6-8f50-a47e57f4787f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:34.809797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e33b6-26ec-46b6-8f50-a47e57f4787f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:34.819123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:34.873127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48a5c1-a23a-4e56-a668-069ab65b9aa5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:34.906701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd50ec-bbfb-430a-961a-61adb31847be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:34.907357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd50ec-bbfb-430a-961a-61adb31847be None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:34.907637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd50ec-bbfb-430a-961a-61adb31847be None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:34.907911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd50ec-bbfb-430a-961a-61adb31847be None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:34.913103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 251/506] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:34.913256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd50ec-bbfb-430a-961a-61adb31847be None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:34.913256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd50ec-bbfb-430a-961a-61adb31847be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:34.913415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e33b6-26ec-46b6-8f50-a47e57f4787f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.913504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd50ec-bbfb-430a-961a-61adb31847be None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:34.918184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 256/507] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:34.918998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd50ec-bbfb-430a-961a-61adb31847be None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:34.948545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.006849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e33b6-26ec-46b6-8f50-a47e57f4787f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.016558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.018314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd50ec-bbfb-430a-961a-61adb31847be None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.041858 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118d8c5-f450-4eb9-942b-8396ac12b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.042498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118d8c5-f450-4eb9-942b-8396ac12b666 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.042779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118d8c5-f450-4eb9-942b-8396ac12b666 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.043056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118d8c5-f450-4eb9-942b-8396ac12b666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.051920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ae382-2de2-4904-809b-4db92a2ce0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.052606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ae382-2de2-4904-809b-4db92a2ce0dd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.052892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ae382-2de2-4904-809b-4db92a2ce0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.053176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ae382-2de2-4904-809b-4db92a2ce0dd None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.053900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ae382-2de2-4904-809b-4db92a2ce0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:35.054212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ae382-2de2-4904-809b-4db92a2ce0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.055587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ae382-2de2-4904-809b-4db92a2ce0dd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.066858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 257/508] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:35.068124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e99f4-b6a5-4cfd-9840-0a56ba094113 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.068445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e99f4-b6a5-4cfd-9840-0a56ba094113 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.068730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e99f4-b6a5-4cfd-9840-0a56ba094113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.085346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-357e99f4-b6a5-4cfd-9840-0a56ba094113 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:35.086533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-357e99f4-b6a5-4cfd-9840-0a56ba094113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:35.109268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118d8c5-f450-4eb9-942b-8396ac12b666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.110707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118d8c5-f450-4eb9-942b-8396ac12b666 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.151592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 258/509] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:35.152542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e99f4-b6a5-4cfd-9840-0a56ba094113 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.173924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.211559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 252/510] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:35.212415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118d8c5-f450-4eb9-942b-8396ac12b666 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.223771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.250857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e99f4-b6a5-4cfd-9840-0a56ba094113 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.284815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4c5a-826d-4822-b90f-d608750d7105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.285539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4c5a-826d-4822-b90f-d608750d7105 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.285833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4c5a-826d-4822-b90f-d608750d7105 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.286110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4c5a-826d-4822-b90f-d608750d7105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.296141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4c5a-826d-4822-b90f-d608750d7105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.297650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c4c5a-826d-4822-b90f-d608750d7105 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.309584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118d8c5-f450-4eb9-942b-8396ac12b666 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-407c4c5a-826d-4822-b90f-d608750d7105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:35.315515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:35.316531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:35.317619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:35.317619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:35.317619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:35.317619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:35.317619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 259/511] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:35.317975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4c5a-826d-4822-b90f-d608750d7105 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.346735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6a422-a2c4-4205-a331-ea67d22cedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.347521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6a422-a2c4-4205-a331-ea67d22cedae None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.347803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6a422-a2c4-4205-a331-ea67d22cedae None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.348076 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6a422-a2c4-4205-a331-ea67d22cedae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.358359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6a422-a2c4-4205-a331-ea67d22cedae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.359834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6a422-a2c4-4205-a331-ea67d22cedae None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-09d6a422-a2c4-4205-a331-ea67d22cedae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:35.377980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:35.378868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:35.379714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:35.379714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:35.379714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:35.379714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:35.379714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 253/512] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:35.380268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6a422-a2c4-4205-a331-ea67d22cedae None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.386276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.415386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4c5a-826d-4822-b90f-d608750d7105 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.443294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.449170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b58a7-83b1-4cab-8102-e47e1c363039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.450511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b58a7-83b1-4cab-8102-e47e1c363039 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.450790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b58a7-83b1-4cab-8102-e47e1c363039 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.451061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b58a7-83b1-4cab-8102-e47e1c363039 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.458259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b58a7-83b1-4cab-8102-e47e1c363039 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.459718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b58a7-83b1-4cab-8102-e47e1c363039 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-755b58a7-83b1-4cab-8102-e47e1c363039 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:35.474243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:35.475237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:35.476158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 260/513] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:35.476764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b58a7-83b1-4cab-8102-e47e1c363039 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.490707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6a422-a2c4-4205-a331-ea67d22cedae None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.524939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663d08e-c504-47c9-bb3d-44b9852b2a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.525715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663d08e-c504-47c9-bb3d-44b9852b2a73 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.525998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663d08e-c504-47c9-bb3d-44b9852b2a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.526270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663d08e-c504-47c9-bb3d-44b9852b2a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.537341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663d08e-c504-47c9-bb3d-44b9852b2a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.538747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663d08e-c504-47c9-bb3d-44b9852b2a73 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1663d08e-c504-47c9-bb3d-44b9852b2a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:35.555754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:35.556616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:35.557457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:35.557457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:35.557457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:35.557457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:35.557457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 254/514] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:35.557722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663d08e-c504-47c9-bb3d-44b9852b2a73 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.573577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b58a7-83b1-4cab-8102-e47e1c363039 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.602879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.607908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a00606-c316-4a97-95a8-261a6d204b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.608715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a00606-c316-4a97-95a8-261a6d204b94 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.614196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a00606-c316-4a97-95a8-261a6d204b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.614196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a00606-c316-4a97-95a8-261a6d204b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.618801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a00606-c316-4a97-95a8-261a6d204b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.620265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a00606-c316-4a97-95a8-261a6d204b94 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-08a00606-c316-4a97-95a8-261a6d204b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:35.638741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:35.639634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:35.640543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:35.640543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:35.640543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:35.640543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:35.640543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 261/515] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:35.640808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a00606-c316-4a97-95a8-261a6d204b94 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.657342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663d08e-c504-47c9-bb3d-44b9852b2a73 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.670362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.690997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6846e-bbd5-4317-8c79-02048f90476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.691653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6846e-bbd5-4317-8c79-02048f90476d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.691936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6846e-bbd5-4317-8c79-02048f90476d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.692213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6846e-bbd5-4317-8c79-02048f90476d None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.692964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6846e-bbd5-4317-8c79-02048f90476d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:35.693269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6846e-bbd5-4317-8c79-02048f90476d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.694700 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6846e-bbd5-4317-8c79-02048f90476d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.706653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 255/516] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:35.707433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6846e-bbd5-4317-8c79-02048f90476d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.744408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a00606-c316-4a97-95a8-261a6d204b94 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.777301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329546a-0b08-4b54-ad8e-8aecc936b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.777956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329546a-0b08-4b54-ad8e-8aecc936b201 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.778242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329546a-0b08-4b54-ad8e-8aecc936b201 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.778529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329546a-0b08-4b54-ad8e-8aecc936b201 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.779252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329546a-0b08-4b54-ad8e-8aecc936b201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:35.779561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329546a-0b08-4b54-ad8e-8aecc936b201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.780971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329546a-0b08-4b54-ad8e-8aecc936b201 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.793036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 262/517] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:35.794332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329546a-0b08-4b54-ad8e-8aecc936b201 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.808870 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6846e-bbd5-4317-8c79-02048f90476d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.839284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.844130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0f9b5-4c46-4931-8237-9cfbd295527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.844839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0f9b5-4c46-4931-8237-9cfbd295527f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.845125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0f9b5-4c46-4931-8237-9cfbd295527f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.845400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0f9b5-4c46-4931-8237-9cfbd295527f None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.846236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0f9b5-4c46-4931-8237-9cfbd295527f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:35.846550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0f9b5-4c46-4931-8237-9cfbd295527f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.847965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0f9b5-4c46-4931-8237-9cfbd295527f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.865592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 256/518] 10.222.0.15 () {56 vars in 1137 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:35.866385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0f9b5-4c46-4931-8237-9cfbd295527f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.895475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329546a-0b08-4b54-ad8e-8aecc936b201 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:35.896850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:35.928121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b5641-d376-4d6c-aa0d-253f7aa3e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:35.928799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b5641-d376-4d6c-aa0d-253f7aa3e316 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:35.929079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b5641-d376-4d6c-aa0d-253f7aa3e316 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:35.929352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b5641-d376-4d6c-aa0d-253f7aa3e316 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:35.930066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b5641-d376-4d6c-aa0d-253f7aa3e316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:35.930374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b5641-d376-4d6c-aa0d-253f7aa3e316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:35.931753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b5641-d376-4d6c-aa0d-253f7aa3e316 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:35.943691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 263/519] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:35.944499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b5641-d376-4d6c-aa0d-253f7aa3e316 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:35.967909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0f9b5-4c46-4931-8237-9cfbd295527f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.001915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c853a6-7450-400d-9c8f-a079c1953412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.002575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c853a6-7450-400d-9c8f-a079c1953412 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.002860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c853a6-7450-400d-9c8f-a079c1953412 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.003134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c853a6-7450-400d-9c8f-a079c1953412 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.003886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c853a6-7450-400d-9c8f-a079c1953412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:36.004193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c853a6-7450-400d-9c8f-a079c1953412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.005587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c853a6-7450-400d-9c8f-a079c1953412 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.017187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 257/520] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:36.017964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c853a6-7450-400d-9c8f-a079c1953412 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.045878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b5641-d376-4d6c-aa0d-253f7aa3e316 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.048059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:36.080108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6762-9565-4d33-8b63-70d5095974f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.080950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6762-9565-4d33-8b63-70d5095974f2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.081232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6762-9565-4d33-8b63-70d5095974f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.081505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6762-9565-4d33-8b63-70d5095974f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.088762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6762-9565-4d33-8b63-70d5095974f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.090208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6762-9565-4d33-8b63-70d5095974f2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ab0e6762-9565-4d33-8b63-70d5095974f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:36.104354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:36.105505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:36.106544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:36.106544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:36.106544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:36.106544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:36.106544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:36.106544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:36.106544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:36.106544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:36.106544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 264/521] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:36.107109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6762-9565-4d33-8b63-70d5095974f2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.110067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:36.119691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c853a6-7450-400d-9c8f-a079c1953412 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.153581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0523cf-874f-42b4-a469-47e958e6cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.154359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0523cf-874f-42b4-a469-47e958e6cc5b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.154643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0523cf-874f-42b4-a469-47e958e6cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.154911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0523cf-874f-42b4-a469-47e958e6cc5b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.161754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0523cf-874f-42b4-a469-47e958e6cc5b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.163192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0523cf-874f-42b4-a469-47e958e6cc5b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-4d0523cf-874f-42b4-a469-47e958e6cc5b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:36.178342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:36.179388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 258/522] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:36.180598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0523cf-874f-42b4-a469-47e958e6cc5b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.208431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6762-9565-4d33-8b63-70d5095974f2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.241893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f186af-a902-43c5-8163-038b59683354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.242529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f186af-a902-43c5-8163-038b59683354 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.242811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f186af-a902-43c5-8163-038b59683354 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.243086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f186af-a902-43c5-8163-038b59683354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.273037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:36.280650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0523cf-874f-42b4-a469-47e958e6cc5b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.309162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f186af-a902-43c5-8163-038b59683354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.310545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f186af-a902-43c5-8163-038b59683354 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.312583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858e8cc-a946-464d-ba40-f286272a80f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.313248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858e8cc-a946-464d-ba40-f286272a80f3 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.313529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858e8cc-a946-464d-ba40-f286272a80f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.313807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858e8cc-a946-464d-ba40-f286272a80f3 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.314499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858e8cc-a946-464d-ba40-f286272a80f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.315917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858e8cc-a946-464d-ba40-f286272a80f3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.380257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 259/523] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:04:36 2022] POST /identity/v3/users => generated 247 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:04:36.381092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858e8cc-a946-464d-ba40-f286272a80f3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.408586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 265/524] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:36.409902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f186af-a902-43c5-8163-038b59683354 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.411541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:36.483480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:36.521663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858e8cc-a946-464d-ba40-f286272a80f3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.526870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f186af-a902-43c5-8163-038b59683354 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.559314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c638686-9dbb-4d8a-a938-edaafcda0e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.560417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638686-9dbb-4d8a-a938-edaafcda0e8f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.560417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638686-9dbb-4d8a-a938-edaafcda0e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.560639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638686-9dbb-4d8a-a938-edaafcda0e8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.568165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c638686-9dbb-4d8a-a938-edaafcda0e8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.569297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fb2ef-ef16-410c-83b1-68c2876ad459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.569636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c638686-9dbb-4d8a-a938-edaafcda0e8f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.570005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fb2ef-ef16-410c-83b1-68c2876ad459 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.570233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fb2ef-ef16-410c-83b1-68c2876ad459 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.570520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fb2ef-ef16-410c-83b1-68c2876ad459 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.571299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fb2ef-ef16-410c-83b1-68c2876ad459 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:36.571607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fb2ef-ef16-410c-83b1-68c2876ad459 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.573061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fb2ef-ef16-410c-83b1-68c2876ad459 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-4c638686-9dbb-4d8a-a938-edaafcda0e8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:36.585843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:36.586746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:36.587641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:36.587641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:36.587641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:36.587641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:36.587641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:36.587641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:36.587641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:36.587641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:36.587641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 260/525] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:36.588440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c638686-9dbb-4d8a-a938-edaafcda0e8f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.593909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 266/526] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:36.594822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fb2ef-ef16-410c-83b1-68c2876ad459 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.669351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:36.702647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fb2ef-ef16-410c-83b1-68c2876ad459 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.707691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c638686-9dbb-4d8a-a938-edaafcda0e8f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.729466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:36.741133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08c6a-2643-4398-8dac-c8da25e69403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.741923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08c6a-2643-4398-8dac-c8da25e69403 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.742288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08c6a-2643-4398-8dac-c8da25e69403 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.742476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08c6a-2643-4398-8dac-c8da25e69403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.746359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff70e4-ca21-4f1f-aa2e-35873a18c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.747762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff70e4-ca21-4f1f-aa2e-35873a18c987 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.748044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff70e4-ca21-4f1f-aa2e-35873a18c987 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.748358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff70e4-ca21-4f1f-aa2e-35873a18c987 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.749171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff70e4-ca21-4f1f-aa2e-35873a18c987 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:36.749486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff70e4-ca21-4f1f-aa2e-35873a18c987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.750955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff70e4-ca21-4f1f-aa2e-35873a18c987 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.753307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08c6a-2643-4398-8dac-c8da25e69403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.755264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08c6a-2643-4398-8dac-c8da25e69403 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.770466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 261/527] 10.222.0.15 () {56 vars in 1139 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:36.771286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff70e4-ca21-4f1f-aa2e-35873a18c987 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a8f08c6a-2643-4398-8dac-c8da25e69403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:36.774211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:36.775071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:36.775931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:36.775931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:36.775931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:36.775931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:36.779912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 267/528] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:36.780630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08c6a-2643-4398-8dac-c8da25e69403 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.883244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff70e4-ca21-4f1f-aa2e-35873a18c987 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.890104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08c6a-2643-4398-8dac-c8da25e69403 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:36.907696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:36.922011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1301f2-635d-4db4-96d7-fa93a198ebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.923860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1301f2-635d-4db4-96d7-fa93a198ebc4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.923860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1301f2-635d-4db4-96d7-fa93a198ebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.923860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1301f2-635d-4db4-96d7-fa93a198ebc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.924064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4edb7-7c45-4b43-958e-d73c5f61c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:36.924148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1301f2-635d-4db4-96d7-fa93a198ebc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:36.924396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1301f2-635d-4db4-96d7-fa93a198ebc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.924489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4edb7-7c45-4b43-958e-d73c5f61c69d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:36.924770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4edb7-7c45-4b43-958e-d73c5f61c69d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:36.925041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4edb7-7c45-4b43-958e-d73c5f61c69d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:36.925859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4edb7-7c45-4b43-958e-d73c5f61c69d None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=51f966be1d764324b7695e1caf578291) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:36.925959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1301f2-635d-4db4-96d7-fa93a198ebc4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.926168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4edb7-7c45-4b43-958e-d73c5f61c69d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:36.927597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4edb7-7c45-4b43-958e-d73c5f61c69d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:36.944743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 268/529] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/role_assignments?user.id=51f966be1d764324b7695e1caf578291&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:36.944743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4edb7-7c45-4b43-958e-d73c5f61c69d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:36.946329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 262/530] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:36.947469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1301f2-635d-4db4-96d7-fa93a198ebc4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:37.005335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:37.083481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1301f2-635d-4db4-96d7-fa93a198ebc4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:37.086285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4edb7-7c45-4b43-958e-d73c5f61c69d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:37.131144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17ab7-a9b9-45de-9296-bf51427e58ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:37.132245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17ab7-a9b9-45de-9296-bf51427e58ee None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:37.132616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d6613-2ce1-4b42-b32d-75716aecb75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:37.132849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17ab7-a9b9-45de-9296-bf51427e58ee None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:37.133315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d6613-2ce1-4b42-b32d-75716aecb75e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:37.133438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17ab7-a9b9-45de-9296-bf51427e58ee None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:37.133527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d6613-2ce1-4b42-b32d-75716aecb75e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:37.133807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d6613-2ce1-4b42-b32d-75716aecb75e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:37.134729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea17ab7-a9b9-45de-9296-bf51427e58ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:37.135227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea17ab7-a9b9-45de-9296-bf51427e58ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:37.137057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea17ab7-a9b9-45de-9296-bf51427e58ee None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:37.152410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 263/531] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:37.153324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17ab7-a9b9-45de-9296-bf51427e58ee None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:37.203670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:37.216915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d6613-2ce1-4b42-b32d-75716aecb75e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:37.218490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d6613-2ce1-4b42-b32d-75716aecb75e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:37.262455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17ab7-a9b9-45de-9296-bf51427e58ee None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:37.263212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:37.298183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a7153-8caa-4a37-9ed1-b917eb8828e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:37.298841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a7153-8caa-4a37-9ed1-b917eb8828e4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:37.299122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a7153-8caa-4a37-9ed1-b917eb8828e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:37.299608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a7153-8caa-4a37-9ed1-b917eb8828e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:37.300464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a7153-8caa-4a37-9ed1-b917eb8828e4 None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=99b95fdb06a94c1586148df32413085f) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:37.301659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a7153-8caa-4a37-9ed1-b917eb8828e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:37.303211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a7153-8caa-4a37-9ed1-b917eb8828e4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:37.316646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 264/532] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:37 2022] GET /identity/v3/role_assignments?user.id=99b95fdb06a94c1586148df32413085f&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:37.317747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a7153-8caa-4a37-9ed1-b917eb8828e4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:37.327337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 269/533] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:37.333013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d6613-2ce1-4b42-b32d-75716aecb75e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:37.488142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d6613-2ce1-4b42-b32d-75716aecb75e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:37.520936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a7153-8caa-4a37-9ed1-b917eb8828e4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:37.538652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:37.568670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22db2c-fa58-44b2-a6a7-d297e949ff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:37.570952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22db2c-fa58-44b2-a6a7-d297e949ff92 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:37.570952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22db2c-fa58-44b2-a6a7-d297e949ff92 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:37.570952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22db2c-fa58-44b2-a6a7-d297e949ff92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:37.579862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22db2c-fa58-44b2-a6a7-d297e949ff92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:37.580099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b47af-05e3-46fd-938c-0865cfe54d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:37.581065 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b47af-05e3-46fd-938c-0865cfe54d72 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:37.581498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b47af-05e3-46fd-938c-0865cfe54d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:37.581844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22db2c-fa58-44b2-a6a7-d297e949ff92 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:37.582069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b47af-05e3-46fd-938c-0865cfe54d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:37.596073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-df22db2c-fa58-44b2-a6a7-d297e949ff92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:37.602028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:37.602863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:37.603696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:37.603696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:37.603696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:37.603696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:37.603696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:37.603696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:37.603696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:37.603696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:37.603696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 265/534] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:37.605046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b47af-05e3-46fd-938c-0865cfe54d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:37.607399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b47af-05e3-46fd-938c-0865cfe54d72 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:37.611257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22db2c-fa58-44b2-a6a7-d297e949ff92 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cb3b47af-05e3-46fd-938c-0865cfe54d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:37.628944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:37.629826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:37.630676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:37.630676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:37.630676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:37.630676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:37.654592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 270/535] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:37.659983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b47af-05e3-46fd-938c-0865cfe54d72 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:37.722918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22db2c-fa58-44b2-a6a7-d297e949ff92 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:37.763458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b2cb-d1fc-49d4-ac6b-c692e1fb934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:37.764132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b2cb-d1fc-49d4-ac6b-c692e1fb934f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:37.764448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b2cb-d1fc-49d4-ac6b-c692e1fb934f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:37.764726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b2cb-d1fc-49d4-ac6b-c692e1fb934f None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:37.765511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917b2cb-d1fc-49d4-ac6b-c692e1fb934f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:37.765821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917b2cb-d1fc-49d4-ac6b-c692e1fb934f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:37.767775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917b2cb-d1fc-49d4-ac6b-c692e1fb934f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:37.781765 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 266/536] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:37.792768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b2cb-d1fc-49d4-ac6b-c692e1fb934f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:37.827792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:37.907234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b2cb-d1fc-49d4-ac6b-c692e1fb934f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:37.943838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f6d5e-619d-4d5b-99fa-67df1e2a918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:37.944537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f6d5e-619d-4d5b-99fa-67df1e2a918f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:37.944825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f6d5e-619d-4d5b-99fa-67df1e2a918f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:37.945106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f6d5e-619d-4d5b-99fa-67df1e2a918f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:37.945945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f6d5e-619d-4d5b-99fa-67df1e2a918f None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=e479d9969f534788b2f35685e4e28da8) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:37.946394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f6d5e-619d-4d5b-99fa-67df1e2a918f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:37.948386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f6d5e-619d-4d5b-99fa-67df1e2a918f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:37.957086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 267/537] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:37 2022] GET /identity/v3/role_assignments?user.id=e479d9969f534788b2f35685e4e28da8&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:37.958451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b47af-05e3-46fd-938c-0865cfe54d72 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:38.011087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c7c02-565a-4431-b120-b2762dc9d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:38.011769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c7c02-565a-4431-b120-b2762dc9d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:38.012622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c7c02-565a-4431-b120-b2762dc9d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:38.012902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c7c02-565a-4431-b120-b2762dc9d0b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:38.013787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c7c02-565a-4431-b120-b2762dc9d0b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:38.014039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c7c02-565a-4431-b120-b2762dc9d0b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:38.015437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c7c02-565a-4431-b120-b2762dc9d0b6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:38.034775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 271/538] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:38.040692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f6d5e-619d-4d5b-99fa-67df1e2a918f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:38.148819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:38.158137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f6d5e-619d-4d5b-99fa-67df1e2a918f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:38.195089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855233d-655d-472c-b0e9-d7ee4e789599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:38.195895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855233d-655d-472c-b0e9-d7ee4e789599 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:38.196178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855233d-655d-472c-b0e9-d7ee4e789599 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:38.196490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855233d-655d-472c-b0e9-d7ee4e789599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:38.204864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855233d-655d-472c-b0e9-d7ee4e789599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:38.206548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855233d-655d-472c-b0e9-d7ee4e789599 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a855233d-655d-472c-b0e9-d7ee4e789599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:38.221696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:38.223783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:38.224995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:38.224995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:38.224995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:38.224995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:38.224995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:38.224995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:38.224995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:38.224995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:38.224995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 268/539] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:38.230361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c7c02-565a-4431-b120-b2762dc9d0b6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:38.296860 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:38.357322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c7c02-565a-4431-b120-b2762dc9d0b6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:38.392879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689a117-a272-4a08-a6ae-2e016ef9b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:38.393539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689a117-a272-4a08-a6ae-2e016ef9b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:38.393822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689a117-a272-4a08-a6ae-2e016ef9b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:38.394100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689a117-a272-4a08-a6ae-2e016ef9b2d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:38.394885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689a117-a272-4a08-a6ae-2e016ef9b2d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:38.395194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689a117-a272-4a08-a6ae-2e016ef9b2d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:38.396652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689a117-a272-4a08-a6ae-2e016ef9b2d8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:38.409905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 272/540] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:38.415557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855233d-655d-472c-b0e9-d7ee4e789599 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:38.518205 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855233d-655d-472c-b0e9-d7ee4e789599 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:38.552189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefba106-8ee5-46ef-b112-4e63026d89ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:38.552800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefba106-8ee5-46ef-b112-4e63026d89ae None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:38.553085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefba106-8ee5-46ef-b112-4e63026d89ae None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:38.553363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefba106-8ee5-46ef-b112-4e63026d89ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:38.554182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefba106-8ee5-46ef-b112-4e63026d89ae None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=e22fe8105f01400ab6ac3dc14c7aa7f7) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:38.554500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefba106-8ee5-46ef-b112-4e63026d89ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:38.555920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefba106-8ee5-46ef-b112-4e63026d89ae None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:38.561800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 269/541] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:38 2022] GET /identity/v3/role_assignments?user.id=e22fe8105f01400ab6ac3dc14c7aa7f7&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:38.874191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f9445-24d3-418b-a97b-2d616ecc9c2b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:38.874697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f9445-24d3-418b-a97b-2d616ecc9c2b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:38.875136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f9445-24d3-418b-a97b-2d616ecc9c2b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:38.876935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 273/542] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:38.882324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37645f71-c649-4544-a123-2370f7831bb6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:38.883097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37645f71-c649-4544-a123-2370f7831bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:38.883541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37645f71-c649-4544-a123-2370f7831bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:38.905329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-37645f71-c649-4544-a123-2370f7831bb6 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:38.906744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-37645f71-c649-4544-a123-2370f7831bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:38.918475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:38.994447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 270/543] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:39.035606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f9445-24d3-418b-a97b-2d616ecc9c2b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:39.178101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f9445-24d3-418b-a97b-2d616ecc9c2b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:39.192743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:39.215213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ad351-98d8-48d2-aeac-f5768e8bffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:39.216337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ad351-98d8-48d2-aeac-f5768e8bffe2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:39.216829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ad351-98d8-48d2-aeac-f5768e8bffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:39.217307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ad351-98d8-48d2-aeac-f5768e8bffe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:39.228574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ad351-98d8-48d2-aeac-f5768e8bffe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-143ad351-98d8-48d2-aeac-f5768e8bffe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:39.236549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:39.237433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:39.238245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:39.240904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 274/544] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:39.249414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37645f71-c649-4544-a123-2370f7831bb6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:39.396188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37645f71-c649-4544-a123-2370f7831bb6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:39.442600 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f76eb5-b416-41a8-872b-fa4f1ca13107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:39.443195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f76eb5-b416-41a8-872b-fa4f1ca13107 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:39.443477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f76eb5-b416-41a8-872b-fa4f1ca13107 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:39.443755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f76eb5-b416-41a8-872b-fa4f1ca13107 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:39.444519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f76eb5-b416-41a8-872b-fa4f1ca13107 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:39.444823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f76eb5-b416-41a8-872b-fa4f1ca13107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:39.446179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f76eb5-b416-41a8-872b-fa4f1ca13107 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:39.459636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 271/545] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:39.465589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ad351-98d8-48d2-aeac-f5768e8bffe2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:39.484683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379159c3-4b61-42de-807e-a64f47c1b8a9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:39.485295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379159c3-4b61-42de-807e-a64f47c1b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:39.485796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379159c3-4b61-42de-807e-a64f47c1b8a9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:39.487629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 272/546] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:04:39.492847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f58ce-7e08-4ebf-ada0-2ec33227b860 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:39.493292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f58ce-7e08-4ebf-ada0-2ec33227b860 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:39.493711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f58ce-7e08-4ebf-ada0-2ec33227b860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:39.526044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e40f58ce-7e08-4ebf-ada0-2ec33227b860 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:39.527272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e40f58ce-7e08-4ebf-ada0-2ec33227b860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:39.530738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:39.641017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ad351-98d8-48d2-aeac-f5768e8bffe2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:39.655507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 273/547] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:39.680431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce294c8a-67aa-4add-b9ae-a5d5cea1a50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:39.681488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce294c8a-67aa-4add-b9ae-a5d5cea1a50c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:39.681922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce294c8a-67aa-4add-b9ae-a5d5cea1a50c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:39.682622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce294c8a-67aa-4add-b9ae-a5d5cea1a50c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:39.698925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce294c8a-67aa-4add-b9ae-a5d5cea1a50c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:39.698925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce294c8a-67aa-4add-b9ae-a5d5cea1a50c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:39.699192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f58ce-7e08-4ebf-ada0-2ec33227b860 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ce294c8a-67aa-4add-b9ae-a5d5cea1a50c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:39.719850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:39.720913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:39.721842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:39.721842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:39.721842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:39.721842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:39.721842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 275/548] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:39.726740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce294c8a-67aa-4add-b9ae-a5d5cea1a50c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:39.771035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:39.872688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f58ce-7e08-4ebf-ada0-2ec33227b860 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:39.954687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a02762-2c0a-47a9-9171-c7e4196909e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:39.955453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a02762-2c0a-47a9-9171-c7e4196909e0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:39.955717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a02762-2c0a-47a9-9171-c7e4196909e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:39.955994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a02762-2c0a-47a9-9171-c7e4196909e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:39.960355 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce294c8a-67aa-4add-b9ae-a5d5cea1a50c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:39.976970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:39.985918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a02762-2c0a-47a9-9171-c7e4196909e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e7a02762-2c0a-47a9-9171-c7e4196909e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:40.000118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:40.001256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:40.002182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 274/549] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:40.013016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a02762-2c0a-47a9-9171-c7e4196909e0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.046692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d05c7-fcad-4361-ba70-ae54d47c0e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:40.047368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d05c7-fcad-4361-ba70-ae54d47c0e2f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.047656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d05c7-fcad-4361-ba70-ae54d47c0e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.047933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d05c7-fcad-4361-ba70-ae54d47c0e2f None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.049805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d05c7-fcad-4361-ba70-ae54d47c0e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:40.050120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d05c7-fcad-4361-ba70-ae54d47c0e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:40.051507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d05c7-fcad-4361-ba70-ae54d47c0e2f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:40.068656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 276/550] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:40.073684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d05c7-fcad-4361-ba70-ae54d47c0e2f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.167040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:40.172830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a02762-2c0a-47a9-9171-c7e4196909e0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:40.184949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d05c7-fcad-4361-ba70-ae54d47c0e2f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:40.208450 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfbb31-9b9d-4734-be98-913793fd279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:40.209334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfbb31-9b9d-4734-be98-913793fd279d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.209758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfbb31-9b9d-4734-be98-913793fd279d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.210270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfbb31-9b9d-4734-be98-913793fd279d None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.211154 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfbb31-9b9d-4734-be98-913793fd279d None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:40.211597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfbb31-9b9d-4734-be98-913793fd279d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:40.213449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfbb31-9b9d-4734-be98-913793fd279d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:40.222832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 275/551] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:40.224397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b84ce9-6a29-4c08-86e3-60a204692c07 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.224845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b84ce9-6a29-4c08-86e3-60a204692c07 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.225265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b84ce9-6a29-4c08-86e3-60a204692c07 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.225659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912332a-b312-4667-a957-c364a61fc950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:40.226529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912332a-b312-4667-a957-c364a61fc950 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.226885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912332a-b312-4667-a957-c364a61fc950 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.227183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 276/552] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:40.227290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912332a-b312-4667-a957-c364a61fc950 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.228250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b84ce9-6a29-4c08-86e3-60a204692c07 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.235834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912332a-b312-4667-a957-c364a61fc950 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:40.237352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912332a-b312-4667-a957-c364a61fc950 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1912332a-b312-4667-a957-c364a61fc950 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:40.253211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:40.254152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:40.255073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 277/553] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:40.256080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2840a5-696e-46e3-a657-b6cade3d18f4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.256651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2840a5-696e-46e3-a657-b6cade3d18f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.257127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2840a5-696e-46e3-a657-b6cade3d18f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.275890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ac2840a5-696e-46e3-a657-b6cade3d18f4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:40.277461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ac2840a5-696e-46e3-a657-b6cade3d18f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:40.294092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:40.336443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b84ce9-6a29-4c08-86e3-60a204692c07 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:40.352660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 278/554] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:40.353711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2840a5-696e-46e3-a657-b6cade3d18f4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.371808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c35ec-e7b3-4166-84d9-963046c2df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:40.372897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c35ec-e7b3-4166-84d9-963046c2df26 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.373392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c35ec-e7b3-4166-84d9-963046c2df26 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.373837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c35ec-e7b3-4166-84d9-963046c2df26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.384768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c35ec-e7b3-4166-84d9-963046c2df26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:40.386419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c35ec-e7b3-4166-84d9-963046c2df26 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-936c35ec-e7b3-4166-84d9-963046c2df26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:40.405420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:40.406339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:40.407197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:40.407197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:40.407197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:40.407197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:40.409392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 277/555] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:40.410327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c35ec-e7b3-4166-84d9-963046c2df26 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.437480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:40.466478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2840a5-696e-46e3-a657-b6cade3d18f4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:40.505648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e263a5-64c7-4cad-be94-1997c069040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:40.506681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e263a5-64c7-4cad-be94-1997c069040b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.507116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e263a5-64c7-4cad-be94-1997c069040b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.507684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e263a5-64c7-4cad-be94-1997c069040b None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.508741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e263a5-64c7-4cad-be94-1997c069040b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:40.509290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e263a5-64c7-4cad-be94-1997c069040b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:40.511147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e263a5-64c7-4cad-be94-1997c069040b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:40.513654 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c35ec-e7b3-4166-84d9-963046c2df26 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:40.529157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:40.533624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 279/556] 10.222.0.15 () {56 vars in 1135 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:40.535002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e263a5-64c7-4cad-be94-1997c069040b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.552508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f93ae0-a7bd-40f7-9241-1498a06d235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:40.553487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f93ae0-a7bd-40f7-9241-1498a06d235d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.553843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f93ae0-a7bd-40f7-9241-1498a06d235d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.554191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f93ae0-a7bd-40f7-9241-1498a06d235d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.566647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f93ae0-a7bd-40f7-9241-1498a06d235d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-38f93ae0-a7bd-40f7-9241-1498a06d235d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:40.574599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:40.575726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:40.577250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:40.578132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 278/557] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:40.579035 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f93ae0-a7bd-40f7-9241-1498a06d235d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.655744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e263a5-64c7-4cad-be94-1997c069040b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:40.681432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f93ae0-a7bd-40f7-9241-1498a06d235d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:40.689015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:40.695544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4fce3-c0f3-42df-b802-4b4ab763c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:40.696510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4fce3-c0f3-42df-b802-4b4ab763c353 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.700890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4fce3-c0f3-42df-b802-4b4ab763c353 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.700890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4fce3-c0f3-42df-b802-4b4ab763c353 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.700890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4fce3-c0f3-42df-b802-4b4ab763c353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:40.700890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4fce3-c0f3-42df-b802-4b4ab763c353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:40.700890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4fce3-c0f3-42df-b802-4b4ab763c353 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:40.713849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 280/558] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:40.715647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4fce3-c0f3-42df-b802-4b4ab763c353 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.717456 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511ffe2-6216-48b1-932e-07fda45ae2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:40.718056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511ffe2-6216-48b1-932e-07fda45ae2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.718330 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511ffe2-6216-48b1-932e-07fda45ae2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.718605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511ffe2-6216-48b1-932e-07fda45ae2a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.762444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:40.793809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511ffe2-6216-48b1-932e-07fda45ae2a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:40.795257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511ffe2-6216-48b1-932e-07fda45ae2a5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:40.833028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4fce3-c0f3-42df-b802-4b4ab763c353 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:40.869737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b74fe-7f59-4b3a-90f1-b835d8944bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:40.870695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b74fe-7f59-4b3a-90f1-b835d8944bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.871151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b74fe-7f59-4b3a-90f1-b835d8944bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.871456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b74fe-7f59-4b3a-90f1-b835d8944bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.872681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b74fe-7f59-4b3a-90f1-b835d8944bf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:40.873001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b74fe-7f59-4b3a-90f1-b835d8944bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:40.874454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b74fe-7f59-4b3a-90f1-b835d8944bf4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:40.882828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 281/559] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:40.886658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b74fe-7f59-4b3a-90f1-b835d8944bf4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.961538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 279/560] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:40.963752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd1f2d-7d9e-4c0d-9082-d8e4d7fbf556 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:40.964177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd1f2d-7d9e-4c0d-9082-d8e4d7fbf556 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:40.964637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd1f2d-7d9e-4c0d-9082-d8e4d7fbf556 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:40.966978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 280/561] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:40.967940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd1f2d-7d9e-4c0d-9082-d8e4d7fbf556 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:40.985927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.035007 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b74fe-7f59-4b3a-90f1-b835d8944bf4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.040196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.076764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86db43-d385-40f9-b627-ec36254f200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.077570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86db43-d385-40f9-b627-ec36254f200a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.077856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86db43-d385-40f9-b627-ec36254f200a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.078110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd1f2d-7d9e-4c0d-9082-d8e4d7fbf556 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.078213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86db43-d385-40f9-b627-ec36254f200a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.086713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86db43-d385-40f9-b627-ec36254f200a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.088524 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86db43-d385-40f9-b627-ec36254f200a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9c86db43-d385-40f9-b627-ec36254f200a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:41.107896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:41.109091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 282/562] 10.222.0.15 () {56 vars in 1093 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:41.110056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86db43-d385-40f9-b627-ec36254f200a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.118495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd8e4b-cf95-4c9b-b7ae-e4653ef4a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.119288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd8e4b-cf95-4c9b-b7ae-e4653ef4a51b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.119573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd8e4b-cf95-4c9b-b7ae-e4653ef4a51b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.119890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd8e4b-cf95-4c9b-b7ae-e4653ef4a51b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.130756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd8e4b-cf95-4c9b-b7ae-e4653ef4a51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.132704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd8e4b-cf95-4c9b-b7ae-e4653ef4a51b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-28bd8e4b-cf95-4c9b-b7ae-e4653ef4a51b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:41.151306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:41.152225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:41.153756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:41.153756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:41.153756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:41.153756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:41.156611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 281/563] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:41.157762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ca1e5-1127-4ce6-856e-5b9246bc05a6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.158048 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ca1e5-1127-4ce6-856e-5b9246bc05a6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.158327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ca1e5-1127-4ce6-856e-5b9246bc05a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.175372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-965ca1e5-1127-4ce6-856e-5b9246bc05a6 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:41.176381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-965ca1e5-1127-4ce6-856e-5b9246bc05a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:41.220114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86db43-d385-40f9-b627-ec36254f200a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.234290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.247601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 282/564] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:41.248293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ca1e5-1127-4ce6-856e-5b9246bc05a6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.255110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6932c-0048-4901-a0aa-f2562318ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.256021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6932c-0048-4901-a0aa-f2562318ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.256302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6932c-0048-4901-a0aa-f2562318ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.256612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6932c-0048-4901-a0aa-f2562318ab2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.268630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6932c-0048-4901-a0aa-f2562318ab2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.270164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6932c-0048-4901-a0aa-f2562318ab2a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-66e6932c-0048-4901-a0aa-f2562318ab2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:41.287246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:41.288186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:41.289964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:41.289964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:41.289964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:41.289964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:41.289964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 283/565] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:41.289964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6932c-0048-4901-a0aa-f2562318ab2a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.304361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.349432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ca1e5-1127-4ce6-856e-5b9246bc05a6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.381893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677b9bc-f84e-484e-8b2f-a811505c9139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.382561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b9bc-f84e-484e-8b2f-a811505c9139 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.382841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b9bc-f84e-484e-8b2f-a811505c9139 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.383116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b9bc-f84e-484e-8b2f-a811505c9139 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.383936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677b9bc-f84e-484e-8b2f-a811505c9139 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:41.384246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677b9bc-f84e-484e-8b2f-a811505c9139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.385684 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677b9bc-f84e-484e-8b2f-a811505c9139 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.385983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6932c-0048-4901-a0aa-f2562318ab2a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.402650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 283/566] 10.222.0.15 () {56 vars in 1133 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:41.403901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60a186-b237-421a-872d-fc2efa3da079 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.404191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60a186-b237-421a-872d-fc2efa3da079 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.404506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60a186-b237-421a-872d-fc2efa3da079 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.405722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 284/567] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:41.406407 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60a186-b237-421a-872d-fc2efa3da079 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.424043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3341b6-42d2-4972-8ed3-5ddab3809105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.424744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3341b6-42d2-4972-8ed3-5ddab3809105 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.425023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3341b6-42d2-4972-8ed3-5ddab3809105 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.425297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3341b6-42d2-4972-8ed3-5ddab3809105 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.426009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3341b6-42d2-4972-8ed3-5ddab3809105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:41.426312 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3341b6-42d2-4972-8ed3-5ddab3809105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.427668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3341b6-42d2-4972-8ed3-5ddab3809105 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.439654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 284/568] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:41.440584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3341b6-42d2-4972-8ed3-5ddab3809105 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.467250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.506133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60a186-b237-421a-872d-fc2efa3da079 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.521152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.538599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3341b6-42d2-4972-8ed3-5ddab3809105 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.541687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a98be-ab4c-46cb-a1f3-e4ae59889d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.542477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a98be-ab4c-46cb-a1f3-e4ae59889d01 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.542760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a98be-ab4c-46cb-a1f3-e4ae59889d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.543564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a98be-ab4c-46cb-a1f3-e4ae59889d01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.554341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a98be-ab4c-46cb-a1f3-e4ae59889d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ae5a98be-ab4c-46cb-a1f3-e4ae59889d01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:41.562557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:41.563543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:41.564423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 285/569] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:41.565132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a98be-ab4c-46cb-a1f3-e4ae59889d01 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.576858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cef67-5afa-4b4a-85d0-52b24a3ecdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.577509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cef67-5afa-4b4a-85d0-52b24a3ecdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.577790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cef67-5afa-4b4a-85d0-52b24a3ecdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.578069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cef67-5afa-4b4a-85d0-52b24a3ecdd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.578787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cef67-5afa-4b4a-85d0-52b24a3ecdd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:41.579092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cef67-5afa-4b4a-85d0-52b24a3ecdd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.580485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cef67-5afa-4b4a-85d0-52b24a3ecdd1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.591650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 285/570] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:41.592934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd9793-3285-4f65-8341-51e1187fb4a4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.593224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd9793-3285-4f65-8341-51e1187fb4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.593502 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd9793-3285-4f65-8341-51e1187fb4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.609605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-13dd9793-3285-4f65-8341-51e1187fb4a4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:41.610778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13dd9793-3285-4f65-8341-51e1187fb4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:41.670433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a98be-ab4c-46cb-a1f3-e4ae59889d01 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.673923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 286/571] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:41.674779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd9793-3285-4f65-8341-51e1187fb4a4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.691596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.706003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9511c6-c6b6-44be-8662-cb56c902d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.708952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9511c6-c6b6-44be-8662-cb56c902d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.708952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9511c6-c6b6-44be-8662-cb56c902d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.708952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9511c6-c6b6-44be-8662-cb56c902d3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.717756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9511c6-c6b6-44be-8662-cb56c902d3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.719197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9511c6-c6b6-44be-8662-cb56c902d3e6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ee9511c6-c6b6-44be-8662-cb56c902d3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:41.736943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:41.737996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:41.743644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:41.743644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:41.743644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:41.743644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:41.743644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 286/572] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:41.743644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9511c6-c6b6-44be-8662-cb56c902d3e6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.766083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.773629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd9793-3285-4f65-8341-51e1187fb4a4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.807489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055ebeb-e86e-4962-bff8-c48298e9a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.808277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055ebeb-e86e-4962-bff8-c48298e9a7de None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.808584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055ebeb-e86e-4962-bff8-c48298e9a7de None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.809428 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055ebeb-e86e-4962-bff8-c48298e9a7de None admin] PATH_INFO: `/v3/users/glance` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.816329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055ebeb-e86e-4962-bff8-c48298e9a7de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.817782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055ebeb-e86e-4962-bff8-c48298e9a7de None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4055ebeb-e86e-4962-bff8-c48298e9a7de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:41.831967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:41.833130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 287/573] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:41.834243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055ebeb-e86e-4962-bff8-c48298e9a7de None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.846714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9511c6-c6b6-44be-8662-cb56c902d3e6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.881230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee30be-676a-4544-b47b-188996152702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.881925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee30be-676a-4544-b47b-188996152702 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.882211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee30be-676a-4544-b47b-188996152702 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.882495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee30be-676a-4544-b47b-188996152702 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.883234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee30be-676a-4544-b47b-188996152702 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:41.883578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee30be-676a-4544-b47b-188996152702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.884967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee30be-676a-4544-b47b-188996152702 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.892846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 287/574] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:41.893621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee30be-676a-4544-b47b-188996152702 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:41.914508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.937063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055ebeb-e86e-4962-bff8-c48298e9a7de None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.971612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde3aaa-6aae-4529-93a6-b35528ad0384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:41.972429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde3aaa-6aae-4529-93a6-b35528ad0384 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:41.972718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde3aaa-6aae-4529-93a6-b35528ad0384 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:41.972988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde3aaa-6aae-4529-93a6-b35528ad0384 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:41.978466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:41.979555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde3aaa-6aae-4529-93a6-b35528ad0384 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:41.981678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde3aaa-6aae-4529-93a6-b35528ad0384 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:41.993349 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee30be-676a-4544-b47b-188996152702 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-8bde3aaa-6aae-4529-93a6-b35528ad0384 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:41.995032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:41.995859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 288/575] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:41.997160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde3aaa-6aae-4529-93a6-b35528ad0384 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.028423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fb5e9-4a01-4e5e-8183-879c6f8a7d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.029437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb5e9-4a01-4e5e-8183-879c6f8a7d82 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.029720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb5e9-4a01-4e5e-8183-879c6f8a7d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.029994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb5e9-4a01-4e5e-8183-879c6f8a7d82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.039841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fb5e9-4a01-4e5e-8183-879c6f8a7d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-d84fb5e9-4a01-4e5e-8183-879c6f8a7d82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:42.048064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:42.049063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:42.049926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 288/576] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:42.050621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fb5e9-4a01-4e5e-8183-879c6f8a7d82 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.099141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde3aaa-6aae-4529-93a6-b35528ad0384 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.131435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c76cff-43de-4296-8529-62ff76abb98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.132083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c76cff-43de-4296-8529-62ff76abb98a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.132395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c76cff-43de-4296-8529-62ff76abb98a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.132677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c76cff-43de-4296-8529-62ff76abb98a None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.133391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c76cff-43de-4296-8529-62ff76abb98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:42.133698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c76cff-43de-4296-8529-62ff76abb98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.135063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c76cff-43de-4296-8529-62ff76abb98a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:42.146652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 289/577] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:42.147451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c76cff-43de-4296-8529-62ff76abb98a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.151011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fb5e9-4a01-4e5e-8183-879c6f8a7d82 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.184757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97672-b60d-4ac3-9b9c-e718d787dc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.185424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97672-b60d-4ac3-9b9c-e718d787dc65 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.185711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97672-b60d-4ac3-9b9c-e718d787dc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.185989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97672-b60d-4ac3-9b9c-e718d787dc65 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.186816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba97672-b60d-4ac3-9b9c-e718d787dc65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:42.187124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba97672-b60d-4ac3-9b9c-e718d787dc65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.188576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba97672-b60d-4ac3-9b9c-e718d787dc65 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.205027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 289/578] 10.222.0.15 () {56 vars in 1137 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:42.205811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97672-b60d-4ac3-9b9c-e718d787dc65 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.209407 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:42.244265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c76cff-43de-4296-8529-62ff76abb98a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.278312 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23d5a6-27ec-4ec2-8eb9-d539a5026c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.279142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23d5a6-27ec-4ec2-8eb9-d539a5026c90 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.279378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23d5a6-27ec-4ec2-8eb9-d539a5026c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.279657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23d5a6-27ec-4ec2-8eb9-d539a5026c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.289404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23d5a6-27ec-4ec2-8eb9-d539a5026c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.290853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23d5a6-27ec-4ec2-8eb9-d539a5026c90 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.304633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97672-b60d-4ac3-9b9c-e718d787dc65 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7c23d5a6-27ec-4ec2-8eb9-d539a5026c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:42.307795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:42.308703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:42.309611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:42.309611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:42.309611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:42.309611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:42.309611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 290/579] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:42.309899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23d5a6-27ec-4ec2-8eb9-d539a5026c90 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.340741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db16ff-7770-4797-8fd7-927327bd5fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.341394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db16ff-7770-4797-8fd7-927327bd5fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.341676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db16ff-7770-4797-8fd7-927327bd5fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.341957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db16ff-7770-4797-8fd7-927327bd5fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.342726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db16ff-7770-4797-8fd7-927327bd5fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:42.343038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db16ff-7770-4797-8fd7-927327bd5fc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.344482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db16ff-7770-4797-8fd7-927327bd5fc4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.356132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 290/580] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:42.356640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:42.356939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db16ff-7770-4797-8fd7-927327bd5fc4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.411123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23d5a6-27ec-4ec2-8eb9-d539a5026c90 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.416392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:42.443930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447a3e-c239-426e-80e1-3f04dbad05e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.444863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447a3e-c239-426e-80e1-3f04dbad05e8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.444863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447a3e-c239-426e-80e1-3f04dbad05e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.445154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447a3e-c239-426e-80e1-3f04dbad05e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.445886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447a3e-c239-426e-80e1-3f04dbad05e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:42.446189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447a3e-c239-426e-80e1-3f04dbad05e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.447558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447a3e-c239-426e-80e1-3f04dbad05e8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.453564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db16ff-7770-4797-8fd7-927327bd5fc4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.455721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 291/581] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:42.456512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447a3e-c239-426e-80e1-3f04dbad05e8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.487688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bdbd7-a008-47b2-8dab-2bb7dcb4edb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.488506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bdbd7-a008-47b2-8dab-2bb7dcb4edb5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.488788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bdbd7-a008-47b2-8dab-2bb7dcb4edb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.489061 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bdbd7-a008-47b2-8dab-2bb7dcb4edb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.497288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bdbd7-a008-47b2-8dab-2bb7dcb4edb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.499033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bdbd7-a008-47b2-8dab-2bb7dcb4edb5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f15bdbd7-a008-47b2-8dab-2bb7dcb4edb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:42.513929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:42.514857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:42.515740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:42.515740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:42.515740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:42.515740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:42.515740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:42.515740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:42.515740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:42.515740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:42.515740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 291/582] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:42.516434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bdbd7-a008-47b2-8dab-2bb7dcb4edb5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.557503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447a3e-c239-426e-80e1-3f04dbad05e8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.567344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:42.590630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd3e68-2184-4c24-a30b-af3e5ee332ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.591411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd3e68-2184-4c24-a30b-af3e5ee332ad None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.591706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd3e68-2184-4c24-a30b-af3e5ee332ad None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.591980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd3e68-2184-4c24-a30b-af3e5ee332ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.602245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd3e68-2184-4c24-a30b-af3e5ee332ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.603688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd3e68-2184-4c24-a30b-af3e5ee332ad None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.612778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bdbd7-a008-47b2-8dab-2bb7dcb4edb5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d6dd3e68-2184-4c24-a30b-af3e5ee332ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:42.623686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:42.624791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:42.625733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:42.625733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:42.625733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:42.625733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:42.625733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 292/583] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:42.625733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd3e68-2184-4c24-a30b-af3e5ee332ad None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.640260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:42.650477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935850-ae75-4512-85f7-ccf7ceb904fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.651135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935850-ae75-4512-85f7-ccf7ceb904fd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.664415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935850-ae75-4512-85f7-ccf7ceb904fd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.664415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935850-ae75-4512-85f7-ccf7ceb904fd None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.664415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935850-ae75-4512-85f7-ccf7ceb904fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:42.664415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935850-ae75-4512-85f7-ccf7ceb904fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.664415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935850-ae75-4512-85f7-ccf7ceb904fd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.665521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 292/584] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:42.666294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935850-ae75-4512-85f7-ccf7ceb904fd None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.727693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd3e68-2184-4c24-a30b-af3e5ee332ad None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.762421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd925-eb31-4e10-93e2-f1fef91bf722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.763072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd925-eb31-4e10-93e2-f1fef91bf722 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.763284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935850-ae75-4512-85f7-ccf7ceb904fd None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.763383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd925-eb31-4e10-93e2-f1fef91bf722 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.763632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd925-eb31-4e10-93e2-f1fef91bf722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.764497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd925-eb31-4e10-93e2-f1fef91bf722 None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=80bd57e333be4921b6270b54a1fac2ef) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:42.764819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd925-eb31-4e10-93e2-f1fef91bf722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.766258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd925-eb31-4e10-93e2-f1fef91bf722 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.771599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 293/585] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/role_assignments?user.id=80bd57e333be4921b6270b54a1fac2ef&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:42.772399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd925-eb31-4e10-93e2-f1fef91bf722 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.806639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:42.819591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9588fb-3bfd-47d2-a2f7-5981e5379ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.819925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9588fb-3bfd-47d2-a2f7-5981e5379ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.820164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9588fb-3bfd-47d2-a2f7-5981e5379ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.820450 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9588fb-3bfd-47d2-a2f7-5981e5379ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.835529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9588fb-3bfd-47d2-a2f7-5981e5379ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.837237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9588fb-3bfd-47d2-a2f7-5981e5379ca7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-7c9588fb-3bfd-47d2-a2f7-5981e5379ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:42.856250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:42.857431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:42.858320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:42.858320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:42.858320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:42.858320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:42.858320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 293/586] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:42.858320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9588fb-3bfd-47d2-a2f7-5981e5379ca7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.898995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd925-eb31-4e10-93e2-f1fef91bf722 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:42.901057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:42.938452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4698-2d78-47aa-bb40-25967fecaf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:42.939129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4698-2d78-47aa-bb40-25967fecaf76 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:42.939410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4698-2d78-47aa-bb40-25967fecaf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:42.939685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4698-2d78-47aa-bb40-25967fecaf76 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:42.940512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d4698-2d78-47aa-bb40-25967fecaf76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:42.940823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d4698-2d78-47aa-bb40-25967fecaf76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:42.942286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d4698-2d78-47aa-bb40-25967fecaf76 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:42.956391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 294/587] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:42.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4698-2d78-47aa-bb40-25967fecaf76 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:42.977313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9588fb-3bfd-47d2-a2f7-5981e5379ca7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.013739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd806f-b6cd-4364-8f02-c370fac87cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.014394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd806f-b6cd-4364-8f02-c370fac87cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.014664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd806f-b6cd-4364-8f02-c370fac87cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.015024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd806f-b6cd-4364-8f02-c370fac87cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.015655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd806f-b6cd-4364-8f02-c370fac87cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:43.016098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd806f-b6cd-4364-8f02-c370fac87cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.017568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd806f-b6cd-4364-8f02-c370fac87cc4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.029238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 294/588] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:43.030036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd806f-b6cd-4364-8f02-c370fac87cc4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.052858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:43.070695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4698-2d78-47aa-bb40-25967fecaf76 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.108604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74350986-4604-4150-858f-9a8c6ace7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.109396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74350986-4604-4150-858f-9a8c6ace7b64 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.109676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74350986-4604-4150-858f-9a8c6ace7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.109953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74350986-4604-4150-858f-9a8c6ace7b64 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.117192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74350986-4604-4150-858f-9a8c6ace7b64 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.118637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74350986-4604-4150-858f-9a8c6ace7b64 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.133552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-74350986-4604-4150-858f-9a8c6ace7b64 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:43.136063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:43.137292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 03:04:43.138263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:43.141866 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 295/589] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:43.146929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd806f-b6cd-4364-8f02-c370fac87cc4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.147058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74350986-4604-4150-858f-9a8c6ace7b64 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.177714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e03d-8b4a-4a3b-92e6-2d980f985a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.178376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e03d-8b4a-4a3b-92e6-2d980f985a0c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.178654 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e03d-8b4a-4a3b-92e6-2d980f985a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.178931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e03d-8b4a-4a3b-92e6-2d980f985a0c None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.179637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41e03d-8b4a-4a3b-92e6-2d980f985a0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:43.179995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41e03d-8b4a-4a3b-92e6-2d980f985a0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.181501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41e03d-8b4a-4a3b-92e6-2d980f985a0c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.197805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 295/590] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:43.197805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e03d-8b4a-4a3b-92e6-2d980f985a0c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.253810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74350986-4604-4150-858f-9a8c6ace7b64 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.289812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a27e09-935e-4293-9acf-bc6a1497e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.290696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a27e09-935e-4293-9acf-bc6a1497e7e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.290978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a27e09-935e-4293-9acf-bc6a1497e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.291252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a27e09-935e-4293-9acf-bc6a1497e7e2 None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/51f966be1d764324b7695e1caf578291/roles/515757e98f5646209fb1eb39aa40ead4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.299771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e03d-8b4a-4a3b-92e6-2d980f985a0c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.307100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a27e09-935e-4293-9acf-bc6a1497e7e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=51f966be1d764324b7695e1caf578291, role_id=515757e98f5646209fb1eb39aa40ead4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.308630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a27e09-935e-4293-9acf-bc6a1497e7e2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.312701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:43.335824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc212f-58c7-44f0-9b6b-e94e32c02512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.336578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc212f-58c7-44f0-9b6b-e94e32c02512 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.336862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc212f-58c7-44f0-9b6b-e94e32c02512 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.337138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc212f-58c7-44f0-9b6b-e94e32c02512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.344102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc212f-58c7-44f0-9b6b-e94e32c02512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.345571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc212f-58c7-44f0-9b6b-e94e32c02512 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-56bc212f-58c7-44f0-9b6b-e94e32c02512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:43.360521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:43.361506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:43.362748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:43.362748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:43.362748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:43.362748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:43.362748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:43.362748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:43.362748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:43.362748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:43.362748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 296/591] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:43.363262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc212f-58c7-44f0-9b6b-e94e32c02512 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.381881 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:43.385766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 296/592] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:04:43 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/51f966be1d764324b7695e1caf578291/roles/515757e98f5646209fb1eb39aa40ead4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:43.386710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a27e09-935e-4293-9acf-bc6a1497e7e2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.487894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc212f-58c7-44f0-9b6b-e94e32c02512 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.501076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a27e09-935e-4293-9acf-bc6a1497e7e2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.529271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990892d6-08c2-430d-9d25-67c0131795e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.530479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990892d6-08c2-430d-9d25-67c0131795e8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.531089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990892d6-08c2-430d-9d25-67c0131795e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.531601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990892d6-08c2-430d-9d25-67c0131795e8 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.533865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990892d6-08c2-430d-9d25-67c0131795e8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:43.534451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990892d6-08c2-430d-9d25-67c0131795e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.536370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990892d6-08c2-430d-9d25-67c0131795e8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.539098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd67fa0-66f8-4da9-8d18-5cab5b87ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.539920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67fa0-66f8-4da9-8d18-5cab5b87ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.540201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67fa0-66f8-4da9-8d18-5cab5b87ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.540507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67fa0-66f8-4da9-8d18-5cab5b87ecf9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.550185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd67fa0-66f8-4da9-8d18-5cab5b87ecf9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.551668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd67fa0-66f8-4da9-8d18-5cab5b87ecf9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.564724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 297/593] 10.222.0.15 () {56 vars in 1137 bytes} [Thu May 26 03:04:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:43.565995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990892d6-08c2-430d-9d25-67c0131795e8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cbd67fa0-66f8-4da9-8d18-5cab5b87ecf9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:43.568476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:43.569407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:43.570346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 297/594] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:43.571403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd67fa0-66f8-4da9-8d18-5cab5b87ecf9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.644685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:43.658272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:43.685672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990892d6-08c2-430d-9d25-67c0131795e8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.702494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd67fa0-66f8-4da9-8d18-5cab5b87ecf9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.723018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc3657-576a-4412-b012-6b95354d4a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.724059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc3657-576a-4412-b012-6b95354d4a2b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.724573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc3657-576a-4412-b012-6b95354d4a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.725054 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc3657-576a-4412-b012-6b95354d4a2b None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.726034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc3657-576a-4412-b012-6b95354d4a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:43.726560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc3657-576a-4412-b012-6b95354d4a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.728174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc3657-576a-4412-b012-6b95354d4a2b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.742616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 298/595] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:43.747562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc3657-576a-4412-b012-6b95354d4a2b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.749322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e599-685a-420e-bf36-edfa12b4fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.750114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e599-685a-420e-bf36-edfa12b4fb59 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.750426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e599-685a-420e-bf36-edfa12b4fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.751002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e599-685a-420e-bf36-edfa12b4fb59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.768966 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401e599-685a-420e-bf36-edfa12b4fb59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.770436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401e599-685a-420e-bf36-edfa12b4fb59 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2401e599-685a-420e-bf36-edfa12b4fb59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:43.793887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:43.794813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:43.795707 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:43.795707 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:43.795707 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:43.795707 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:43.799550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 298/596] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:43.800420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e599-685a-420e-bf36-edfa12b4fb59 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.868894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc3657-576a-4412-b012-6b95354d4a2b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.923763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d703e-7132-45cb-afb2-04fc4a4119ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.924388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d703e-7132-45cb-afb2-04fc4a4119ce None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.924672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d703e-7132-45cb-afb2-04fc4a4119ce None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.924945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d703e-7132-45cb-afb2-04fc4a4119ce None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:43.925931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d703e-7132-45cb-afb2-04fc4a4119ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:43.926110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d703e-7132-45cb-afb2-04fc4a4119ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:43.927540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d703e-7132-45cb-afb2-04fc4a4119ce None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:43.935833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:43.945127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e599-685a-420e-bf36-edfa12b4fb59 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:43.948800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 299/597] 10.222.0.15 () {56 vars in 1139 bytes} [Thu May 26 03:04:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:43.950357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d703e-7132-45cb-afb2-04fc4a4119ce None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:43.959994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:43.994885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b424-a79f-461b-b3fb-f9910cd872ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:43.995775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b424-a79f-461b-b3fb-f9910cd872ca None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:43.996089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b424-a79f-461b-b3fb-f9910cd872ca None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:43.996398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b424-a79f-461b-b3fb-f9910cd872ca None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/99b95fdb06a94c1586148df32413085f/roles/515757e98f5646209fb1eb39aa40ead4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:44.018537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b424-a79f-461b-b3fb-f9910cd872ca None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=99b95fdb06a94c1586148df32413085f, role_id=515757e98f5646209fb1eb39aa40ead4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:44.020351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b424-a79f-461b-b3fb-f9910cd872ca None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:44.062652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d703e-7132-45cb-afb2-04fc4a4119ce None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:44.096643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 299/598] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:04:43 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/99b95fdb06a94c1586148df32413085f/roles/515757e98f5646209fb1eb39aa40ead4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:44.098443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b424-a79f-461b-b3fb-f9910cd872ca None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:44.113560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d68e-86ab-485f-a3e1-dc441235a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:44.114242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d68e-86ab-485f-a3e1-dc441235a43d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:44.114527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d68e-86ab-485f-a3e1-dc441235a43d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:44.115087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d68e-86ab-485f-a3e1-dc441235a43d None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:44.115822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764d68e-86ab-485f-a3e1-dc441235a43d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:44.116301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764d68e-86ab-485f-a3e1-dc441235a43d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:44.118495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764d68e-86ab-485f-a3e1-dc441235a43d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:44.133893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 300/599] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:44.139979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d68e-86ab-485f-a3e1-dc441235a43d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:44.250906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:44.316116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b424-a79f-461b-b3fb-f9910cd872ca None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:44.339176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d68e-86ab-485f-a3e1-dc441235a43d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:44.356554 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07374cdb-8415-4f68-8e6b-65d939c006a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:44.357452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07374cdb-8415-4f68-8e6b-65d939c006a4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:44.357739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07374cdb-8415-4f68-8e6b-65d939c006a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:44.358014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07374cdb-8415-4f68-8e6b-65d939c006a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:44.369353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07374cdb-8415-4f68-8e6b-65d939c006a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:44.370892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07374cdb-8415-4f68-8e6b-65d939c006a4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:44.375087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aff0ea-a49f-4476-b18c-902ca898b2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:44.375879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aff0ea-a49f-4476-b18c-902ca898b2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:44.376160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aff0ea-a49f-4476-b18c-902ca898b2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:44.376480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aff0ea-a49f-4476-b18c-902ca898b2c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:44.383417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aff0ea-a49f-4476-b18c-902ca898b2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:44.384896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aff0ea-a49f-4476-b18c-902ca898b2c9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-07374cdb-8415-4f68-8e6b-65d939c006a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:44.390372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:44.391241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:44.393610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:44.393610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:44.393610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:44.393610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:44.393610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 300/600] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:44.397096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07374cdb-8415-4f68-8e6b-65d939c006a4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-56aff0ea-a49f-4476-b18c-902ca898b2c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:44.401008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:44.403086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:44.405325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:44.405325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:44.405325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:44.405325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:44.405325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:44.405325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:44.405325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:44.405325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:44.412551 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 301/601] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:44.412770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:44.414153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aff0ea-a49f-4476-b18c-902ca898b2c9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:44.507678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07374cdb-8415-4f68-8e6b-65d939c006a4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:44.545327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aff0ea-a49f-4476-b18c-902ca898b2c9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:44.547196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2d40d-c079-470e-929c-01a44b1fd415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:44.548794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2d40d-c079-470e-929c-01a44b1fd415 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:44.549083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2d40d-c079-470e-929c-01a44b1fd415 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:44.549364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2d40d-c079-470e-929c-01a44b1fd415 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:44.550090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2d40d-c079-470e-929c-01a44b1fd415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:44.550396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2d40d-c079-470e-929c-01a44b1fd415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:44.551770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2d40d-c079-470e-929c-01a44b1fd415 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:44.565086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 301/602] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:44.571837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2d40d-c079-470e-929c-01a44b1fd415 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:44.580441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:44.651401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56d99-1ad7-412b-b22a-aa10921f0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:44.652131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56d99-1ad7-412b-b22a-aa10921f0c12 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:44.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56d99-1ad7-412b-b22a-aa10921f0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:44.652775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56d99-1ad7-412b-b22a-aa10921f0c12 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:44.653567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c56d99-1ad7-412b-b22a-aa10921f0c12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:44.653879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c56d99-1ad7-412b-b22a-aa10921f0c12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:44.654258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:44.655315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c56d99-1ad7-412b-b22a-aa10921f0c12 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:44.684280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 302/603] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:44.693389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2d40d-c079-470e-929c-01a44b1fd415 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:44.702194 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56d99-1ad7-412b-b22a-aa10921f0c12 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:44.734677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985314-602d-4cb5-824a-f3fa552f0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:44.735913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985314-602d-4cb5-824a-f3fa552f0053 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:44.736184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985314-602d-4cb5-824a-f3fa552f0053 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:44.736723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985314-602d-4cb5-824a-f3fa552f0053 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:44.745639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985314-602d-4cb5-824a-f3fa552f0053 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:44.747725 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985314-602d-4cb5-824a-f3fa552f0053 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-87985314-602d-4cb5-824a-f3fa552f0053 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:44.763150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:44.764951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:44.767071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:44.767071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:44.767071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:44.767071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:44.767071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:44.767071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:44.767071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:44.767071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:44.767071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 302/604] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:44.775290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985314-602d-4cb5-824a-f3fa552f0053 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:44.883339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56d99-1ad7-412b-b22a-aa10921f0c12 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:44.928771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c7727-279d-430b-875f-b18a84237e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:44.930081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c7727-279d-430b-875f-b18a84237e28 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:44.930498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c7727-279d-430b-875f-b18a84237e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:44.930779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c7727-279d-430b-875f-b18a84237e28 None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/e479d9969f534788b2f35685e4e28da8/roles/515757e98f5646209fb1eb39aa40ead4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:44.947091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c7727-279d-430b-875f-b18a84237e28 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=e479d9969f534788b2f35685e4e28da8, role_id=515757e98f5646209fb1eb39aa40ead4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:44.948571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c7727-279d-430b-875f-b18a84237e28 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:44.975809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985314-602d-4cb5-824a-f3fa552f0053 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:45.007164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:45.013075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d512fe-8dff-40b1-92e7-a3c7a5006d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:45.013784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d512fe-8dff-40b1-92e7-a3c7a5006d6f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:45.014015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d512fe-8dff-40b1-92e7-a3c7a5006d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:45.014290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d512fe-8dff-40b1-92e7-a3c7a5006d6f None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:45.015071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d512fe-8dff-40b1-92e7-a3c7a5006d6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:45.015377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d512fe-8dff-40b1-92e7-a3c7a5006d6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:45.016834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d512fe-8dff-40b1-92e7-a3c7a5006d6f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:45.029146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 303/605] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:45.037243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d512fe-8dff-40b1-92e7-a3c7a5006d6f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:45.120507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 303/606] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:04:44 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/e479d9969f534788b2f35685e4e28da8/roles/515757e98f5646209fb1eb39aa40ead4 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:45.122181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74c575-e4eb-4e2d-a684-d5b27b81b99c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:45.122465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74c575-e4eb-4e2d-a684-d5b27b81b99c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:45.122739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74c575-e4eb-4e2d-a684-d5b27b81b99c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:45.126893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 304/607] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:45.133469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcb366-afb6-4a54-a0e6-1c1c6649d39c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:45.133836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcb366-afb6-4a54-a0e6-1c1c6649d39c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:45.134215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcb366-afb6-4a54-a0e6-1c1c6649d39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:45.154868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-56bcb366-afb6-4a54-a0e6-1c1c6649d39c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:45.156431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-56bcb366-afb6-4a54-a0e6-1c1c6649d39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:45.175376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d512fe-8dff-40b1-92e7-a3c7a5006d6f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:45.195232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:45.251856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc441e-1486-4a3e-bd80-cf5d31929e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:45.253156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc441e-1486-4a3e-bd80-cf5d31929e85 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:45.253156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc441e-1486-4a3e-bd80-cf5d31929e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:45.253363 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc441e-1486-4a3e-bd80-cf5d31929e85 None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/e22fe8105f01400ab6ac3dc14c7aa7f7/roles/515757e98f5646209fb1eb39aa40ead4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:45.269889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 305/608] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:45.276592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc441e-1486-4a3e-bd80-cf5d31929e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=e22fe8105f01400ab6ac3dc14c7aa7f7, role_id=515757e98f5646209fb1eb39aa40ead4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:45.278768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc441e-1486-4a3e-bd80-cf5d31929e85 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:45.295235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcb366-afb6-4a54-a0e6-1c1c6649d39c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:45.407502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcb366-afb6-4a54-a0e6-1c1c6649d39c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:45.441627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e373-f10b-4ec7-95f3-ce9a0c99646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:45.442431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e373-f10b-4ec7-95f3-ce9a0c99646f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:45.442718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e373-f10b-4ec7-95f3-ce9a0c99646f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:45.443001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e373-f10b-4ec7-95f3-ce9a0c99646f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:45.453877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5e373-f10b-4ec7-95f3-ce9a0c99646f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-20d5e373-f10b-4ec7-95f3-ce9a0c99646f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:45.461758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:45.463007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:45.463900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 306/609] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:45.469573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e373-f10b-4ec7-95f3-ce9a0c99646f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:45.567911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e373-f10b-4ec7-95f3-ce9a0c99646f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:45.604589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4485d-801f-4c52-b3bc-8f1ed681b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:45.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4485d-801f-4c52-b3bc-8f1ed681b5cc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:45.606195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4485d-801f-4c52-b3bc-8f1ed681b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:45.606723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4485d-801f-4c52-b3bc-8f1ed681b5cc None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:45.607713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4485d-801f-4c52-b3bc-8f1ed681b5cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:45.608225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4485d-801f-4c52-b3bc-8f1ed681b5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:45.609799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4485d-801f-4c52-b3bc-8f1ed681b5cc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:45.619935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 307/610] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:45.625617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4485d-801f-4c52-b3bc-8f1ed681b5cc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:45.628338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:45.689424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 304/611] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:04:45 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/e22fe8105f01400ab6ac3dc14c7aa7f7/roles/515757e98f5646209fb1eb39aa40ead4 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:45.733944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:45.785217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4485d-801f-4c52-b3bc-8f1ed681b5cc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:45.840381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18279950-2b5b-4e56-ad22-67bea3f31d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:45.841164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279950-2b5b-4e56-ad22-67bea3f31d9c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:45.841449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279950-2b5b-4e56-ad22-67bea3f31d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:45.841728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279950-2b5b-4e56-ad22-67bea3f31d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:45.859857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18279950-2b5b-4e56-ad22-67bea3f31d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:45.861352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18279950-2b5b-4e56-ad22-67bea3f31d9c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-18279950-2b5b-4e56-ad22-67bea3f31d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:45.891222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:45.892237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:45.893357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:45.893357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:45.893357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:45.893357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:45.893357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 308/612] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:45.899387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc441e-1486-4a3e-bd80-cf5d31929e85 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:45.924679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be298-7a1e-489c-b733-d9bf59fe2f61 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:45.924961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be298-7a1e-489c-b733-d9bf59fe2f61 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:45.925242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be298-7a1e-489c-b733-d9bf59fe2f61 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:45.927053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 309/613] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:45.936219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf63e01-9584-448d-ae78-c721f94a615c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:45.936531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf63e01-9584-448d-ae78-c721f94a615c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:45.936815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf63e01-9584-448d-ae78-c721f94a615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:45.961437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:45.965447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bcf63e01-9584-448d-ae78-c721f94a615c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:45.966648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bcf63e01-9584-448d-ae78-c721f94a615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:46.046445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc441e-1486-4a3e-bd80-cf5d31929e85 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:46.060833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 310/614] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:46.084784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf63e01-9584-448d-ae78-c721f94a615c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:46.103066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd3c11-b185-4d63-b9cb-e376b24969a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:46.103718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd3c11-b185-4d63-b9cb-e376b24969a0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:46.104000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd3c11-b185-4d63-b9cb-e376b24969a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:46.104273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd3c11-b185-4d63-b9cb-e376b24969a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:46.105025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd3c11-b185-4d63-b9cb-e376b24969a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:46.105826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd3c11-b185-4d63-b9cb-e376b24969a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:46.107233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd3c11-b185-4d63-b9cb-e376b24969a0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:46.131590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 305/615] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:46.137336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd3c11-b185-4d63-b9cb-e376b24969a0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:46.195241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:46.282747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf63e01-9584-448d-ae78-c721f94a615c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:46.323835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:46.326166 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd3c11-b185-4d63-b9cb-e376b24969a0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:46.363643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410eff8-fe4b-4d18-84e4-210ad5eb3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:46.365666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410eff8-fe4b-4d18-84e4-210ad5eb3d1c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:46.366496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cac3d-6a80-4f05-ac4a-8021d1a75871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:46.367060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410eff8-fe4b-4d18-84e4-210ad5eb3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:46.368058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cac3d-6a80-4f05-ac4a-8021d1a75871 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:46.368590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410eff8-fe4b-4d18-84e4-210ad5eb3d1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:46.369750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cac3d-6a80-4f05-ac4a-8021d1a75871 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:46.370270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cac3d-6a80-4f05-ac4a-8021d1a75871 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:46.383320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410eff8-fe4b-4d18-84e4-210ad5eb3d1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:46.385767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410eff8-fe4b-4d18-84e4-210ad5eb3d1c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:46.393128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cac3d-6a80-4f05-ac4a-8021d1a75871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-008cac3d-6a80-4f05-ac4a-8021d1a75871 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:46.401751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:46.403291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:46.404106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3410eff8-fe4b-4d18-84e4-210ad5eb3d1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:46.411237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:46.412156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 03:04:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:46.414320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 311/616] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:46.415791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cac3d-6a80-4f05-ac4a-8021d1a75871 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:46.420458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 306/617] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:46.425897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410eff8-fe4b-4d18-84e4-210ad5eb3d1c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:46.602831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410eff8-fe4b-4d18-84e4-210ad5eb3d1c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:46.610404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cac3d-6a80-4f05-ac4a-8021d1a75871 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:46.640348 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a3ba7-440b-42c9-b2ce-3272b01696a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:46.641373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a3ba7-440b-42c9-b2ce-3272b01696a8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:46.641863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a3ba7-440b-42c9-b2ce-3272b01696a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:46.642429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a3ba7-440b-42c9-b2ce-3272b01696a8 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:46.643453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a3ba7-440b-42c9-b2ce-3272b01696a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:46.643959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a3ba7-440b-42c9-b2ce-3272b01696a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:46.645661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a3ba7-440b-42c9-b2ce-3272b01696a8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:46.659083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:46.666005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 307/618] 10.222.0.15 () {56 vars in 1135 bytes} [Thu May 26 03:04:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:46.677485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a3ba7-440b-42c9-b2ce-3272b01696a8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:46.691732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531b84d-3bfb-4e14-a0b9-ed5df7fafdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:46.692457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531b84d-3bfb-4e14-a0b9-ed5df7fafdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:46.692742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531b84d-3bfb-4e14-a0b9-ed5df7fafdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:46.693017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531b84d-3bfb-4e14-a0b9-ed5df7fafdd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:46.693765 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531b84d-3bfb-4e14-a0b9-ed5df7fafdd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:46.694069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531b84d-3bfb-4e14-a0b9-ed5df7fafdd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:46.695435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531b84d-3bfb-4e14-a0b9-ed5df7fafdd7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:46.708711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:46.715336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 312/619] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:46.721291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531b84d-3bfb-4e14-a0b9-ed5df7fafdd7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:46.789103 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a3ba7-440b-42c9-b2ce-3272b01696a8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:46.825354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04256e-51ef-40cd-ad6e-d04d46ab642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:46.829885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04256e-51ef-40cd-ad6e-d04d46ab642c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:46.829885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04256e-51ef-40cd-ad6e-d04d46ab642c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:46.829885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04256e-51ef-40cd-ad6e-d04d46ab642c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:46.838673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04256e-51ef-40cd-ad6e-d04d46ab642c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:46.841181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04256e-51ef-40cd-ad6e-d04d46ab642c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3e04256e-51ef-40cd-ad6e-d04d46ab642c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:46.860068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:46.861051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:46.862105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:46.862105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:46.862105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:46.862105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:46.864011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 308/620] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:46.874495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04256e-51ef-40cd-ad6e-d04d46ab642c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:46.907122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531b84d-3bfb-4e14-a0b9-ed5df7fafdd7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:46.944491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a99c05-746b-40ce-acbb-371f11ecf887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:46.945921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a99c05-746b-40ce-acbb-371f11ecf887 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:46.946211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a99c05-746b-40ce-acbb-371f11ecf887 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:46.946486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a99c05-746b-40ce-acbb-371f11ecf887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:46.961664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a99c05-746b-40ce-acbb-371f11ecf887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:46.963419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a99c05-746b-40ce-acbb-371f11ecf887 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:46.969566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e4a99c05-746b-40ce-acbb-371f11ecf887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:46.987396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:46.988338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:46.989827 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:46.989827 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:46.989827 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:46.989827 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:46.989827 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 313/621] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:46.992840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e17d11-787f-49fa-84cb-7e7d9f19995e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:46.992840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e17d11-787f-49fa-84cb-7e7d9f19995e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:46.992840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e17d11-787f-49fa-84cb-7e7d9f19995e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:46.993098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 314/622] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:46.997137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e17d11-787f-49fa-84cb-7e7d9f19995e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.006287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04256e-51ef-40cd-ad6e-d04d46ab642c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.036718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:47.053081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97aa26-a653-4a8e-96b4-a5dcad90b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.054334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97aa26-a653-4a8e-96b4-a5dcad90b8de None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.054836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97aa26-a653-4a8e-96b4-a5dcad90b8de None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.055483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97aa26-a653-4a8e-96b4-a5dcad90b8de None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.056851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97aa26-a653-4a8e-96b4-a5dcad90b8de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:47.057662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97aa26-a653-4a8e-96b4-a5dcad90b8de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:47.060227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97aa26-a653-4a8e-96b4-a5dcad90b8de None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:47.081623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 309/623] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:47.086349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9c77f-9a7f-4dfe-b99c-b8f6f0c0e2c9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.086547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9c77f-9a7f-4dfe-b99c-b8f6f0c0e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.086800 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9c77f-9a7f-4dfe-b99c-b8f6f0c0e2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.105819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-aca9c77f-9a7f-4dfe-b99c-b8f6f0c0e2c9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:47.107107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-aca9c77f-9a7f-4dfe-b99c-b8f6f0c0e2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:47.132643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e17d11-787f-49fa-84cb-7e7d9f19995e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.178022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 310/624] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:47.178634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9c77f-9a7f-4dfe-b99c-b8f6f0c0e2c9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.180404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075f438-9efb-4cfb-876d-aea218ac269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.181316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075f438-9efb-4cfb-876d-aea218ac269a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.181820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075f438-9efb-4cfb-876d-aea218ac269a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.182297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075f438-9efb-4cfb-876d-aea218ac269a None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.183220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075f438-9efb-4cfb-876d-aea218ac269a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:47.184286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075f438-9efb-4cfb-876d-aea218ac269a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:47.185881 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075f438-9efb-4cfb-876d-aea218ac269a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:47.200743 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 315/625] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:47.212952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075f438-9efb-4cfb-876d-aea218ac269a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.266405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:47.313043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9c77f-9a7f-4dfe-b99c-b8f6f0c0e2c9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.318856 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:47.329644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075f438-9efb-4cfb-876d-aea218ac269a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.352056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96816d-7171-462b-b95f-3d80f6d3f7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.353273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96816d-7171-462b-b95f-3d80f6d3f7ec None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.353715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96816d-7171-462b-b95f-3d80f6d3f7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.354149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96816d-7171-462b-b95f-3d80f6d3f7ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.362128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96816d-7171-462b-b95f-3d80f6d3f7ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:47.363986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96816d-7171-462b-b95f-3d80f6d3f7ec None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:47.366554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa0bd2-6106-4440-9070-b17107f9af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.367499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0bd2-6106-4440-9070-b17107f9af4c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.367857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0bd2-6106-4440-9070-b17107f9af4c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.368200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0bd2-6106-4440-9070-b17107f9af4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.376119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa0bd2-6106-4440-9070-b17107f9af4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:47.377661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa0bd2-6106-4440-9070-b17107f9af4c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9d96816d-7171-462b-b95f-3d80f6d3f7ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:47.380711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:47.381596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:47.382479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:47.382479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:47.382479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:47.382479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:47.382479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:47.382479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:47.382479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:47.382479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:47.385032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 311/626] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:47.385977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96816d-7171-462b-b95f-3d80f6d3f7ec None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-baaa0bd2-6106-4440-9070-b17107f9af4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:47.398064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:47.399044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:47.400017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 316/627] 10.222.0.15 () {56 vars in 1093 bytes} [Thu May 26 03:04:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:47.400761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa0bd2-6106-4440-9070-b17107f9af4c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.500931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96816d-7171-462b-b95f-3d80f6d3f7ec None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.516813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa0bd2-6106-4440-9070-b17107f9af4c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.525100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:47.540516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198bb84-172f-4a01-b034-1088a6608d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.541705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198bb84-172f-4a01-b034-1088a6608d38 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.542185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198bb84-172f-4a01-b034-1088a6608d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.543403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198bb84-172f-4a01-b034-1088a6608d38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.554611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43340920-e6c2-4619-9079-53c17127ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.555307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43340920-e6c2-4619-9079-53c17127ec30 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.555560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43340920-e6c2-4619-9079-53c17127ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.555839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43340920-e6c2-4619-9079-53c17127ec30 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.556674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43340920-e6c2-4619-9079-53c17127ec30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:47.556935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198bb84-172f-4a01-b034-1088a6608d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:47.557053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43340920-e6c2-4619-9079-53c17127ec30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:47.558952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43340920-e6c2-4619-9079-53c17127ec30 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9198bb84-172f-4a01-b034-1088a6608d38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:47.566683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:47.567618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:47.568478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:47.571343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 312/628] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:47.572423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198bb84-172f-4a01-b034-1088a6608d38 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.573413 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 317/629] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:47.576733 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43340920-e6c2-4619-9079-53c17127ec30 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.590179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:47.685585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198bb84-172f-4a01-b034-1088a6608d38 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.685832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43340920-e6c2-4619-9079-53c17127ec30 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.719260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab0bb6-15b3-48c2-94da-4fba0aab4326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.719930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab0bb6-15b3-48c2-94da-4fba0aab4326 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.720216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab0bb6-15b3-48c2-94da-4fba0aab4326 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.720519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab0bb6-15b3-48c2-94da-4fba0aab4326 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.721258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab0bb6-15b3-48c2-94da-4fba0aab4326 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:47.721574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab0bb6-15b3-48c2-94da-4fba0aab4326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:47.722377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5d066-5a29-4063-bed8-7575fe4ae331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.722938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab0bb6-15b3-48c2-94da-4fba0aab4326 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:47.723046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d066-5a29-4063-bed8-7575fe4ae331 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.723325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d066-5a29-4063-bed8-7575fe4ae331 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.723604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d066-5a29-4063-bed8-7575fe4ae331 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.724475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5d066-5a29-4063-bed8-7575fe4ae331 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:47.724790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5d066-5a29-4063-bed8-7575fe4ae331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:47.726227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5d066-5a29-4063-bed8-7575fe4ae331 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:47.736447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 318/630] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:47.737289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab0bb6-15b3-48c2-94da-4fba0aab4326 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.749500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 313/631] 10.222.0.15 () {56 vars in 1133 bytes} [Thu May 26 03:04:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:47.749500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d069-1017-4f3d-a10d-5b4aee062c26 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.749500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d069-1017-4f3d-a10d-5b4aee062c26 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.749500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d069-1017-4f3d-a10d-5b4aee062c26 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.749500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 314/632] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:47.749500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15d069-1017-4f3d-a10d-5b4aee062c26 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.801832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:47.820208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:47.850729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab0bb6-15b3-48c2-94da-4fba0aab4326 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.860776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15d069-1017-4f3d-a10d-5b4aee062c26 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:47.889673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33f988-74a0-4652-bf65-1190fc8fde77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.890554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33f988-74a0-4652-bf65-1190fc8fde77 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.890830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33f988-74a0-4652-bf65-1190fc8fde77 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.891101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33f988-74a0-4652-bf65-1190fc8fde77 None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/80bd57e333be4921b6270b54a1fac2ef/roles/515757e98f5646209fb1eb39aa40ead4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.896816 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1b8d1-7b97-43a6-941d-bae1cc7bd11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:47.897606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1b8d1-7b97-43a6-941d-bae1cc7bd11d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.897889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1b8d1-7b97-43a6-941d-bae1cc7bd11d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.898163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1b8d1-7b97-43a6-941d-bae1cc7bd11d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:47.907769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33f988-74a0-4652-bf65-1190fc8fde77 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=80bd57e333be4921b6270b54a1fac2ef, role_id=515757e98f5646209fb1eb39aa40ead4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:47.908981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1b8d1-7b97-43a6-941d-bae1cc7bd11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:47.909245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33f988-74a0-4652-bf65-1190fc8fde77 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:47.910443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1b8d1-7b97-43a6-941d-bae1cc7bd11d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bdf1b8d1-7b97-43a6-941d-bae1cc7bd11d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:47.928204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:47.933832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:47.934735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:47.934735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:47.934735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:47.934735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:47.934735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 315/633] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:47.934735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1b8d1-7b97-43a6-941d-bae1cc7bd11d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:47.985497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 319/634] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:04:47 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/80bd57e333be4921b6270b54a1fac2ef/roles/515757e98f5646209fb1eb39aa40ead4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:04:47.986930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fddb23-910b-4fba-a2f9-7885db08eb8a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:47.987297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fddb23-910b-4fba-a2f9-7885db08eb8a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:47.987654 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fddb23-910b-4fba-a2f9-7885db08eb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.014032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-42fddb23-910b-4fba-a2f9-7885db08eb8a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:48.016796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-42fddb23-910b-4fba-a2f9-7885db08eb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:48.047270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:48.061809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1b8d1-7b97-43a6-941d-bae1cc7bd11d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:48.102877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc545eb-ec13-4204-a339-ca50a9f3c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:48.103696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc545eb-ec13-4204-a339-ca50a9f3c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.103990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc545eb-ec13-4204-a339-ca50a9f3c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.104277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc545eb-ec13-4204-a339-ca50a9f3c7d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.128417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 320/635] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:48.130203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fddb23-910b-4fba-a2f9-7885db08eb8a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:48.192670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc545eb-ec13-4204-a339-ca50a9f3c7d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:48.194119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc545eb-ec13-4204-a339-ca50a9f3c7d2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:48.195857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:48.258363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fddb23-910b-4fba-a2f9-7885db08eb8a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:48.294113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:48.295117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610eff5-856a-4980-b8a3-0975e6ed3bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:48.295790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610eff5-856a-4980-b8a3-0975e6ed3bbc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.296070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610eff5-856a-4980-b8a3-0975e6ed3bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.296371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610eff5-856a-4980-b8a3-0975e6ed3bbc None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.297085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610eff5-856a-4980-b8a3-0975e6ed3bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:48.297389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610eff5-856a-4980-b8a3-0975e6ed3bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:48.298740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610eff5-856a-4980-b8a3-0975e6ed3bbc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:48.305261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 316/636] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:48.306331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc545eb-ec13-4204-a339-ca50a9f3c7d2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:48.311492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 321/637] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:48.312800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2461fd-9bb4-4b00-ae6b-fa4657f4031c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.313032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2461fd-9bb4-4b00-ae6b-fa4657f4031c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.313304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2461fd-9bb4-4b00-ae6b-fa4657f4031c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.318725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 322/638] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:48.319518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2461fd-9bb4-4b00-ae6b-fa4657f4031c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:48.417370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc545eb-ec13-4204-a339-ca50a9f3c7d2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:48.426543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2461fd-9bb4-4b00-ae6b-fa4657f4031c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:48.441792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:48.453247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39ffd9-f815-47f0-8695-d9d17a981554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:48.454161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39ffd9-f815-47f0-8695-d9d17a981554 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.454599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39ffd9-f815-47f0-8695-d9d17a981554 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.454877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39ffd9-f815-47f0-8695-d9d17a981554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.462875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1a730-4a73-4cfa-bbca-969339e097e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:48.463667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1a730-4a73-4cfa-bbca-969339e097e4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.463957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1a730-4a73-4cfa-bbca-969339e097e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.464229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1a730-4a73-4cfa-bbca-969339e097e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.467448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39ffd9-f815-47f0-8695-d9d17a981554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:48.474777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1a730-4a73-4cfa-bbca-969339e097e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:48.476214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1a730-4a73-4cfa-bbca-969339e097e4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4c39ffd9-f815-47f0-8695-d9d17a981554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:48.476947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:48.478125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:48.479139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:48.482137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 317/639] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:48.483052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39ffd9-f815-47f0-8695-d9d17a981554 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c9a1a730-4a73-4cfa-bbca-969339e097e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:48.497055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:48.498143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:48.499114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:48.499114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:48.499114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:48.499114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:48.499114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 323/640] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:48.499458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e8065-f50c-482b-9609-932e6a1c8a58 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.499720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e8065-f50c-482b-9609-932e6a1c8a58 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.499997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e8065-f50c-482b-9609-932e6a1c8a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.520393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-246e8065-f50c-482b-9609-932e6a1c8a58 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:48.521562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-246e8065-f50c-482b-9609-932e6a1c8a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:48.541425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:48.590159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 324/641] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:48.591210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e8065-f50c-482b-9609-932e6a1c8a58 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:48.603667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39ffd9-f815-47f0-8695-d9d17a981554 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:48.644536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cb05d-b260-4dc4-b4b0-bd79ff3a1cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:48.645310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cb05d-b260-4dc4-b4b0-bd79ff3a1cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.645595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cb05d-b260-4dc4-b4b0-bd79ff3a1cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.645869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cb05d-b260-4dc4-b4b0-bd79ff3a1cb3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.654484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cb05d-b260-4dc4-b4b0-bd79ff3a1cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:48.655933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cb05d-b260-4dc4-b4b0-bd79ff3a1cb3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7f5cb05d-b260-4dc4-b4b0-bd79ff3a1cb3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:48.671490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:48.672806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 318/642] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:48.673765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cb05d-b260-4dc4-b4b0-bd79ff3a1cb3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:48.697337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:48.704724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e8065-f50c-482b-9609-932e6a1c8a58 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:48.744122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01b4dc-2382-4d4b-b3db-e26151ed9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:48.744847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01b4dc-2382-4d4b-b3db-e26151ed9288 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.745144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01b4dc-2382-4d4b-b3db-e26151ed9288 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.745423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01b4dc-2382-4d4b-b3db-e26151ed9288 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.746227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01b4dc-2382-4d4b-b3db-e26151ed9288 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:48.746538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01b4dc-2382-4d4b-b3db-e26151ed9288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:48.747951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01b4dc-2382-4d4b-b3db-e26151ed9288 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:48.761724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 325/643] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:48.761724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01b4dc-2382-4d4b-b3db-e26151ed9288 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:48.877575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01b4dc-2382-4d4b-b3db-e26151ed9288 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:48.902696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cb05d-b260-4dc4-b4b0-bd79ff3a1cb3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:48.913721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2207e-990c-4f58-9197-51c30d7b4a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:48.914129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:48.914513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2207e-990c-4f58-9197-51c30d7b4a55 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.914800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2207e-990c-4f58-9197-51c30d7b4a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.915074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2207e-990c-4f58-9197-51c30d7b4a55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.926046 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2207e-990c-4f58-9197-51c30d7b4a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-92a2207e-990c-4f58-9197-51c30d7b4a55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:48.933756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:48.934678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:48.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 326/644] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:48.936780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2207e-990c-4f58-9197-51c30d7b4a55 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:48.942951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6027c7d-62f7-4eda-b8d0-51ac1d98d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:48.943748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027c7d-62f7-4eda-b8d0-51ac1d98d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:48.944154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027c7d-62f7-4eda-b8d0-51ac1d98d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:48.944469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027c7d-62f7-4eda-b8d0-51ac1d98d7e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:48.945317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6027c7d-62f7-4eda-b8d0-51ac1d98d7e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:48.945685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6027c7d-62f7-4eda-b8d0-51ac1d98d7e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:48.947112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6027c7d-62f7-4eda-b8d0-51ac1d98d7e6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:48.957783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:48.964450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 319/645] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:48.964450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6027c7d-62f7-4eda-b8d0-51ac1d98d7e6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.039757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2207e-990c-4f58-9197-51c30d7b4a55 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.068834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6027c7d-62f7-4eda-b8d0-51ac1d98d7e6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.073195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b9ff-c7e6-4f93-97a6-54e486aa1983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.073868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b9ff-c7e6-4f93-97a6-54e486aa1983 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.074687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b9ff-c7e6-4f93-97a6-54e486aa1983 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.074962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b9ff-c7e6-4f93-97a6-54e486aa1983 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.075786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b9ff-c7e6-4f93-97a6-54e486aa1983 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:49.076096 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b9ff-c7e6-4f93-97a6-54e486aa1983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.077568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b9ff-c7e6-4f93-97a6-54e486aa1983 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.100056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 327/646] 10.222.0.15 () {56 vars in 1137 bytes} [Thu May 26 03:04:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:49.100056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b9ff-c7e6-4f93-97a6-54e486aa1983 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.112256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66655a6-6d56-4e1f-83de-f19d80e61336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.113258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66655a6-6d56-4e1f-83de-f19d80e61336 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.113551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66655a6-6d56-4e1f-83de-f19d80e61336 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.113826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66655a6-6d56-4e1f-83de-f19d80e61336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.125827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66655a6-6d56-4e1f-83de-f19d80e61336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.127501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66655a6-6d56-4e1f-83de-f19d80e61336 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b66655a6-6d56-4e1f-83de-f19d80e61336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:49.147849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:49.149073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:49.150429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:49.150429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:49.150429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:49.150429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:49.150429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 320/647] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:49.150429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66655a6-6d56-4e1f-83de-f19d80e61336 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.177753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:49.182983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:49.210282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b9ff-c7e6-4f93-97a6-54e486aa1983 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.244299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c20b6-eecb-48d1-aec7-b60332234509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.245000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c20b6-eecb-48d1-aec7-b60332234509 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.245280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c20b6-eecb-48d1-aec7-b60332234509 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.245566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c20b6-eecb-48d1-aec7-b60332234509 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.246337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c20b6-eecb-48d1-aec7-b60332234509 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:49.246640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c20b6-eecb-48d1-aec7-b60332234509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.248368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c20b6-eecb-48d1-aec7-b60332234509 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.257422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 328/648] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:49.258198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c20b6-eecb-48d1-aec7-b60332234509 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.259171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66655a6-6d56-4e1f-83de-f19d80e61336 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.299447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ce2cb-a38c-4851-9b12-2384c13c9c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.300342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ce2cb-a38c-4851-9b12-2384c13c9c55 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.300679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ce2cb-a38c-4851-9b12-2384c13c9c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.300835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ce2cb-a38c-4851-9b12-2384c13c9c55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.307779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ce2cb-a38c-4851-9b12-2384c13c9c55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.309304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ce2cb-a38c-4851-9b12-2384c13c9c55 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-6b7ce2cb-a38c-4851-9b12-2384c13c9c55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:49.325845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:49.326755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:49.327661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:49.327661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:49.327661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:49.327661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:49.327661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:49.327661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:49.327661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:49.327661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:49.328777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 321/649] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:49.329590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ce2cb-a38c-4851-9b12-2384c13c9c55 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.372272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c20b6-eecb-48d1-aec7-b60332234509 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.409543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139194-19d2-45d5-a505-53dff6bc8ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.410472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139194-19d2-45d5-a505-53dff6bc8ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.411021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139194-19d2-45d5-a505-53dff6bc8ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.411520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139194-19d2-45d5-a505-53dff6bc8ce2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.413762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:49.415663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:49.432280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ce2cb-a38c-4851-9b12-2384c13c9c55 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.468772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae9c6-7ae7-47ec-96c3-74d6811eaeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.469431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae9c6-7ae7-47ec-96c3-74d6811eaeee None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.469752 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae9c6-7ae7-47ec-96c3-74d6811eaeee None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.470028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae9c6-7ae7-47ec-96c3-74d6811eaeee None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.470756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ae9c6-7ae7-47ec-96c3-74d6811eaeee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:49.471066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ae9c6-7ae7-47ec-96c3-74d6811eaeee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.472468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ae9c6-7ae7-47ec-96c3-74d6811eaeee None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.481421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71139194-19d2-45d5-a505-53dff6bc8ce2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.482878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71139194-19d2-45d5-a505-53dff6bc8ce2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.488400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 322/650] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:49.488400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae9c6-7ae7-47ec-96c3-74d6811eaeee None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.587722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae9c6-7ae7-47ec-96c3-74d6811eaeee None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.600766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 329/651] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:49.601501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139194-19d2-45d5-a505-53dff6bc8ce2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.622509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054763c-8a67-4088-b443-037071680ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.623303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054763c-8a67-4088-b443-037071680ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.623590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054763c-8a67-4088-b443-037071680ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.623872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054763c-8a67-4088-b443-037071680ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.635237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054763c-8a67-4088-b443-037071680ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.637332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054763c-8a67-4088-b443-037071680ff0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.639548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:49.640002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5054763c-8a67-4088-b443-037071680ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:49.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:49.656467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:49.657576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:49.657576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:49.657576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:49.657576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:49.659106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 323/652] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:49.660151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054763c-8a67-4088-b443-037071680ff0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.713362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139194-19d2-45d5-a505-53dff6bc8ce2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.750179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769e29-2312-4215-a0f3-255589d0ffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.750851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769e29-2312-4215-a0f3-255589d0ffa1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.751137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769e29-2312-4215-a0f3-255589d0ffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.751417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769e29-2312-4215-a0f3-255589d0ffa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.752201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc769e29-2312-4215-a0f3-255589d0ffa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:49.752545 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc769e29-2312-4215-a0f3-255589d0ffa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.753967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc769e29-2312-4215-a0f3-255589d0ffa1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.760481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054763c-8a67-4088-b443-037071680ff0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.766171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 330/653] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:49.766980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769e29-2312-4215-a0f3-255589d0ffa1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.805731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586082c-fdad-44fe-8693-913be82c8c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.806837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586082c-fdad-44fe-8693-913be82c8c84 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.807128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586082c-fdad-44fe-8693-913be82c8c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.807409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586082c-fdad-44fe-8693-913be82c8c84 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.816290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586082c-fdad-44fe-8693-913be82c8c84 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.817782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586082c-fdad-44fe-8693-913be82c8c84 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f586082c-fdad-44fe-8693-913be82c8c84 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:49.833172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:49.840790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 324/654] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:49.841944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586082c-fdad-44fe-8693-913be82c8c84 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.884595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:49.891973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769e29-2312-4215-a0f3-255589d0ffa1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.900885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:49.929052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481c423-eab0-46cc-8cfd-97ba7af171eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.929829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481c423-eab0-46cc-8cfd-97ba7af171eb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.930128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481c423-eab0-46cc-8cfd-97ba7af171eb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.930387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481c423-eab0-46cc-8cfd-97ba7af171eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.941511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481c423-eab0-46cc-8cfd-97ba7af171eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.942954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481c423-eab0-46cc-8cfd-97ba7af171eb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:49.950320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586082c-fdad-44fe-8693-913be82c8c84 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-7481c423-eab0-46cc-8cfd-97ba7af171eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:49.961187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:49.962087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:49.963290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:49.963290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:49.963290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:49.963290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:49.963290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 331/655] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:49.964235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481c423-eab0-46cc-8cfd-97ba7af171eb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:49.990709 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2f47-349b-4e1a-8d91-71602d2cb238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:49.991364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2f47-349b-4e1a-8d91-71602d2cb238 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:49.991639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2f47-349b-4e1a-8d91-71602d2cb238 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:49.991907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2f47-349b-4e1a-8d91-71602d2cb238 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:49.992658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2f47-349b-4e1a-8d91-71602d2cb238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:49.992962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2f47-349b-4e1a-8d91-71602d2cb238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:49.994318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2f47-349b-4e1a-8d91-71602d2cb238 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.006058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 325/656] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:50.006672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2f47-349b-4e1a-8d91-71602d2cb238 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:50.079578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481c423-eab0-46cc-8cfd-97ba7af171eb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:50.114108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2f47-349b-4e1a-8d91-71602d2cb238 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:50.117674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67042aaf-b134-4251-9504-f460dde12d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:50.118336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042aaf-b134-4251-9504-f460dde12d5f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.118624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042aaf-b134-4251-9504-f460dde12d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.118900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042aaf-b134-4251-9504-f460dde12d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.119730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67042aaf-b134-4251-9504-f460dde12d5f None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=51f966be1d764324b7695e1caf578291) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:50.120044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67042aaf-b134-4251-9504-f460dde12d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:50.121548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67042aaf-b134-4251-9504-f460dde12d5f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.127870 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 332/657] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:49 2022] GET /identity/v3/role_assignments?user.id=51f966be1d764324b7695e1caf578291&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:50.128766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67042aaf-b134-4251-9504-f460dde12d5f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:50.139028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:50.145561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:50.172022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7948-3353-43ab-803f-398536526367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:50.173140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7948-3353-43ab-803f-398536526367 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.173635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7948-3353-43ab-803f-398536526367 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.174731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7948-3353-43ab-803f-398536526367 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.175840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e7948-3353-43ab-803f-398536526367 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:50.176412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e7948-3353-43ab-803f-398536526367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:50.178841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e7948-3353-43ab-803f-398536526367 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.203173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 326/658] 10.222.0.15 () {56 vars in 1137 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:50.204488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7948-3353-43ab-803f-398536526367 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:50.254266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67042aaf-b134-4251-9504-f460dde12d5f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:50.298220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1939cc-ccb3-48ed-828d-c6498196521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:50.299059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1939cc-ccb3-48ed-828d-c6498196521b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.299462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1939cc-ccb3-48ed-828d-c6498196521b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.299744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1939cc-ccb3-48ed-828d-c6498196521b None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.300659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1939cc-ccb3-48ed-828d-c6498196521b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:50.300976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1939cc-ccb3-48ed-828d-c6498196521b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:50.302701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1939cc-ccb3-48ed-828d-c6498196521b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.316797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7948-3353-43ab-803f-398536526367 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:50.325028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 333/659] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:50.325028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1939cc-ccb3-48ed-828d-c6498196521b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:50.357002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e825c-e9be-4473-87d3-5e461b295b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:50.357803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e825c-e9be-4473-87d3-5e461b295b9d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.358112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e825c-e9be-4473-87d3-5e461b295b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.358360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e825c-e9be-4473-87d3-5e461b295b9d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.365648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e825c-e9be-4473-87d3-5e461b295b9d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:50.367103 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e825c-e9be-4473-87d3-5e461b295b9d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-513e825c-e9be-4473-87d3-5e461b295b9d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:50.384763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:50.385738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 327/660] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:50.388297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ebba6-bf01-44fd-bdf7-6fa071d234f1 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.389060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ebba6-bf01-44fd-bdf7-6fa071d234f1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.389060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ebba6-bf01-44fd-bdf7-6fa071d234f1 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.390178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 328/661] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:50.390705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ebba6-bf01-44fd-bdf7-6fa071d234f1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:50.408675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:50.426278 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:50.445285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1939cc-ccb3-48ed-828d-c6498196521b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:50.481018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee862d1a-52be-45f3-9160-d0361e3b19a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:50.481909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee862d1a-52be-45f3-9160-d0361e3b19a7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.482254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee862d1a-52be-45f3-9160-d0361e3b19a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.482473 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee862d1a-52be-45f3-9160-d0361e3b19a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.505829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ebba6-bf01-44fd-bdf7-6fa071d234f1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:50.540143 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6449882-9563-4593-940b-150f489daae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:50.540950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6449882-9563-4593-940b-150f489daae7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.541231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6449882-9563-4593-940b-150f489daae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.541510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6449882-9563-4593-940b-150f489daae7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.548780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6449882-9563-4593-940b-150f489daae7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:50.550224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6449882-9563-4593-940b-150f489daae7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.553958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee862d1a-52be-45f3-9160-d0361e3b19a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:50.555392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee862d1a-52be-45f3-9160-d0361e3b19a7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a6449882-9563-4593-940b-150f489daae7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:50.564475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:50.565390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 329/662] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:50.571311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6449882-9563-4593-940b-150f489daae7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:50.635143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:50.662021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:50.668527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 334/663] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:50.670033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2ca31-c279-4243-bc40-0ccffa2377fa None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.670299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2ca31-c279-4243-bc40-0ccffa2377fa None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.670578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2ca31-c279-4243-bc40-0ccffa2377fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.676172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6449882-9563-4593-940b-150f489daae7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:50.688803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-21c2ca31-c279-4243-bc40-0ccffa2377fa None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:50.689988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-21c2ca31-c279-4243-bc40-0ccffa2377fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:50.711892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed0b3-535c-4cb3-afc8-30863c7cce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:50.712861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed0b3-535c-4cb3-afc8-30863c7cce12 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.713149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed0b3-535c-4cb3-afc8-30863c7cce12 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.713426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed0b3-535c-4cb3-afc8-30863c7cce12 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.714263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed0b3-535c-4cb3-afc8-30863c7cce12 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:50.714614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed0b3-535c-4cb3-afc8-30863c7cce12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:50.716045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed0b3-535c-4cb3-afc8-30863c7cce12 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.738600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 330/664] 10.222.0.15 () {56 vars in 1139 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:50.738600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed0b3-535c-4cb3-afc8-30863c7cce12 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:50.763566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 335/665] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:50.765400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2ca31-c279-4243-bc40-0ccffa2377fa None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:50.848214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed0b3-535c-4cb3-afc8-30863c7cce12 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:50.886022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2ca31-c279-4243-bc40-0ccffa2377fa None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:50.887157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78142afe-7933-42f8-9a98-2f6212ab45e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:50.887603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:50.888858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142afe-7933-42f8-9a98-2f6212ab45e0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.889141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142afe-7933-42f8-9a98-2f6212ab45e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.889419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142afe-7933-42f8-9a98-2f6212ab45e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.890202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78142afe-7933-42f8-9a98-2f6212ab45e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:50.890511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78142afe-7933-42f8-9a98-2f6212ab45e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:50.891927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78142afe-7933-42f8-9a98-2f6212ab45e0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.909810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 331/666] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:50.909810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78142afe-7933-42f8-9a98-2f6212ab45e0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:50.920965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf89a3c-541b-4fb6-a460-ed2d994a830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:50.921616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:50.921829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf89a3c-541b-4fb6-a460-ed2d994a830d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:50.922090 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf89a3c-541b-4fb6-a460-ed2d994a830d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:50.922691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf89a3c-541b-4fb6-a460-ed2d994a830d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:50.933770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf89a3c-541b-4fb6-a460-ed2d994a830d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:50.935411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf89a3c-541b-4fb6-a460-ed2d994a830d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ecf89a3c-541b-4fb6-a460-ed2d994a830d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:50.952996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:50.953898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:50.954795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:50.954795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:50.954795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:50.954795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:50.954795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 336/667] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:50.955101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf89a3c-541b-4fb6-a460-ed2d994a830d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.018059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78142afe-7933-42f8-9a98-2f6212ab45e0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:51.053660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838feb2-a327-4a8c-9f71-1a381eca3cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:51.054302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838feb2-a327-4a8c-9f71-1a381eca3cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:51.054586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838feb2-a327-4a8c-9f71-1a381eca3cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:51.054861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838feb2-a327-4a8c-9f71-1a381eca3cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:51.061735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf89a3c-541b-4fb6-a460-ed2d994a830d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:51.099424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3931bd0-bbc5-4537-b42a-196504e43588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:51.100171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3931bd0-bbc5-4537-b42a-196504e43588 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:51.100490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3931bd0-bbc5-4537-b42a-196504e43588 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:51.100770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3931bd0-bbc5-4537-b42a-196504e43588 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:51.112129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3931bd0-bbc5-4537-b42a-196504e43588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-b3931bd0-bbc5-4537-b42a-196504e43588 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:51.120223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:51.121198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:51.122051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 337/668] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:51.123481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3931bd0-bbc5-4537-b42a-196504e43588 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.133713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838feb2-a327-4a8c-9f71-1a381eca3cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:51.135187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838feb2-a327-4a8c-9f71-1a381eca3cf0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:51.148126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:51.243803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 332/669] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:51.245121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838feb2-a327-4a8c-9f71-1a381eca3cf0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.256630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:51.347890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3931bd0-bbc5-4537-b42a-196504e43588 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:51.364036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838feb2-a327-4a8c-9f71-1a381eca3cf0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:51.375380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:51.382173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107b5f4-4c31-4c71-b86d-8d5333308147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:51.382841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107b5f4-4c31-4c71-b86d-8d5333308147 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:51.383125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107b5f4-4c31-4c71-b86d-8d5333308147 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:51.385251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107b5f4-4c31-4c71-b86d-8d5333308147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:51.385251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107b5f4-4c31-4c71-b86d-8d5333308147 None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=99b95fdb06a94c1586148df32413085f) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:51.385251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107b5f4-4c31-4c71-b86d-8d5333308147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:51.385973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107b5f4-4c31-4c71-b86d-8d5333308147 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:51.392951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 338/670] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:51 2022] GET /identity/v3/role_assignments?user.id=99b95fdb06a94c1586148df32413085f&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:51.393740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107b5f4-4c31-4c71-b86d-8d5333308147 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.412130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338c55f-426c-45a1-9950-b8ab99147c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:51.413180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338c55f-426c-45a1-9950-b8ab99147c9b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:51.413675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338c55f-426c-45a1-9950-b8ab99147c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:51.414218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338c55f-426c-45a1-9950-b8ab99147c9b None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:51.415161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338c55f-426c-45a1-9950-b8ab99147c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:51.415716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338c55f-426c-45a1-9950-b8ab99147c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:51.417364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338c55f-426c-45a1-9950-b8ab99147c9b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:51.436856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 333/671] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:51.438079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338c55f-426c-45a1-9950-b8ab99147c9b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.497236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:51.520630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107b5f4-4c31-4c71-b86d-8d5333308147 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:51.562115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0b68-a5e8-4a8b-962a-3c3cb8d8c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:51.562917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0b68-a5e8-4a8b-962a-3c3cb8d8c2dd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:51.563200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0b68-a5e8-4a8b-962a-3c3cb8d8c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:51.563476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0b68-a5e8-4a8b-962a-3c3cb8d8c2dd None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:51.564233 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0b68-a5e8-4a8b-962a-3c3cb8d8c2dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:51.564571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0b68-a5e8-4a8b-962a-3c3cb8d8c2dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:51.565976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0b68-a5e8-4a8b-962a-3c3cb8d8c2dd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:51.575645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 339/672] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:51.576558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0b68-a5e8-4a8b-962a-3c3cb8d8c2dd None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.578303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338c55f-426c-45a1-9950-b8ab99147c9b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:51.627986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e300dc-b37b-4156-beec-04315d0549d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:51.629248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e300dc-b37b-4156-beec-04315d0549d6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:51.629830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e300dc-b37b-4156-beec-04315d0549d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:51.630113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e300dc-b37b-4156-beec-04315d0549d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:51.643091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e300dc-b37b-4156-beec-04315d0549d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:51.645051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e300dc-b37b-4156-beec-04315d0549d6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-95e300dc-b37b-4156-beec-04315d0549d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:51.664850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:51.666017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:51.667117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:51.667117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:51.667117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:51.667117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:51.668760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 334/673] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:51.669604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e300dc-b37b-4156-beec-04315d0549d6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.697342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:51.700021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0b68-a5e8-4a8b-962a-3c3cb8d8c2dd None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:51.742282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa21af-0807-438f-9a28-735748b7b775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:51.743078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa21af-0807-438f-9a28-735748b7b775 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:51.743359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa21af-0807-438f-9a28-735748b7b775 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:51.743632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa21af-0807-438f-9a28-735748b7b775 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:51.753243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa21af-0807-438f-9a28-735748b7b775 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:51.753958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa21af-0807-438f-9a28-735748b7b775 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:51.762858 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-74aa21af-0807-438f-9a28-735748b7b775 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:51.771658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:51.772626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:51.773535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:51.773535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:51.773535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:51.773535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:51.773535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:51.773535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:51.773535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:51.773535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:51.773535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 340/674] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:51.774047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa21af-0807-438f-9a28-735748b7b775 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.794971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e300dc-b37b-4156-beec-04315d0549d6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:51.840883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dce93-1c17-4112-ad7b-6a07dddefd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:51.841799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dce93-1c17-4112-ad7b-6a07dddefd4b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:51.842076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dce93-1c17-4112-ad7b-6a07dddefd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:51.842361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dce93-1c17-4112-ad7b-6a07dddefd4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:51.853257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dce93-1c17-4112-ad7b-6a07dddefd4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:51.854833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dce93-1c17-4112-ad7b-6a07dddefd4b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-8f4dce93-1c17-4112-ad7b-6a07dddefd4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:51.873794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:51.874742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:51.875629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:51.875629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:51.875629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:51.875629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:51.875629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 335/675] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:51.876349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dce93-1c17-4112-ad7b-6a07dddefd4b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.894153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa21af-0807-438f-9a28-735748b7b775 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:51.930570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a61da8-281d-4c48-8a22-cfbe30724d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:51.931247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a61da8-281d-4c48-8a22-cfbe30724d5d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:51.931531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a61da8-281d-4c48-8a22-cfbe30724d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:51.931810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a61da8-281d-4c48-8a22-cfbe30724d5d None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:51.932559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a61da8-281d-4c48-8a22-cfbe30724d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:51.932868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a61da8-281d-4c48-8a22-cfbe30724d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:51.934269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a61da8-281d-4c48-8a22-cfbe30724d5d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:51.946406 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 341/676] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:51.947339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a61da8-281d-4c48-8a22-cfbe30724d5d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:51.955574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:51.982529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dce93-1c17-4112-ad7b-6a07dddefd4b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.010308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:52.019584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb1147-6225-4597-b4d6-6759cd73530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.020254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb1147-6225-4597-b4d6-6759cd73530a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.020566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb1147-6225-4597-b4d6-6759cd73530a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.020850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb1147-6225-4597-b4d6-6759cd73530a None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.021671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb1147-6225-4597-b4d6-6759cd73530a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:52.022095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb1147-6225-4597-b4d6-6759cd73530a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:52.023592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb1147-6225-4597-b4d6-6759cd73530a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:52.037261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 336/677] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:52.038156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb1147-6225-4597-b4d6-6759cd73530a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:52.057083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a61da8-281d-4c48-8a22-cfbe30724d5d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.093591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2faa2-95e9-431f-9db8-9db8bca012c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.094587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2faa2-95e9-431f-9db8-9db8bca012c0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.095052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2faa2-95e9-431f-9db8-9db8bca012c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.095504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2faa2-95e9-431f-9db8-9db8bca012c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.096430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2faa2-95e9-431f-9db8-9db8bca012c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:52.096918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2faa2-95e9-431f-9db8-9db8bca012c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:52.098486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2faa2-95e9-431f-9db8-9db8bca012c0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:52.111543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 342/678] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:52.112701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2faa2-95e9-431f-9db8-9db8bca012c0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:52.144337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb1147-6225-4597-b4d6-6759cd73530a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.178070 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168ecef-842d-4560-99e2-47080a1bb529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.178869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168ecef-842d-4560-99e2-47080a1bb529 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.179151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168ecef-842d-4560-99e2-47080a1bb529 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.179429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168ecef-842d-4560-99e2-47080a1bb529 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.181509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:52.187726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168ecef-842d-4560-99e2-47080a1bb529 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:52.189362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168ecef-842d-4560-99e2-47080a1bb529 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b168ecef-842d-4560-99e2-47080a1bb529 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:52.204334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:52.210206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 337/679] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:52.211137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168ecef-842d-4560-99e2-47080a1bb529 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:52.236297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2faa2-95e9-431f-9db8-9db8bca012c0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.268689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:52.281821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351737-7fa5-4942-9503-0989ad5ff22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.282860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351737-7fa5-4942-9503-0989ad5ff22f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.284110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351737-7fa5-4942-9503-0989ad5ff22f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.284517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351737-7fa5-4942-9503-0989ad5ff22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.285446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a351737-7fa5-4942-9503-0989ad5ff22f None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=e479d9969f534788b2f35685e4e28da8) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:52.285860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a351737-7fa5-4942-9503-0989ad5ff22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:52.287369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a351737-7fa5-4942-9503-0989ad5ff22f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:52.295901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 343/680] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:52 2022] GET /identity/v3/role_assignments?user.id=e479d9969f534788b2f35685e4e28da8&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:52.296971 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351737-7fa5-4942-9503-0989ad5ff22f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:52.321624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168ecef-842d-4560-99e2-47080a1bb529 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.391656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0908fac-3b21-4849-a953-e0e46dd64cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.392503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0908fac-3b21-4849-a953-e0e46dd64cde None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.392785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0908fac-3b21-4849-a953-e0e46dd64cde None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.393060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0908fac-3b21-4849-a953-e0e46dd64cde None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.412197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0908fac-3b21-4849-a953-e0e46dd64cde None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:52.413637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0908fac-3b21-4849-a953-e0e46dd64cde None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f0908fac-3b21-4849-a953-e0e46dd64cde None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:52.430814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:52.431912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:52.434074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 338/681] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:52.434669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ada521-918e-41be-a675-1af8bd9aca76 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.434669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ada521-918e-41be-a675-1af8bd9aca76 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.434991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ada521-918e-41be-a675-1af8bd9aca76 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.440450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 339/682] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:52.440450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ada521-918e-41be-a675-1af8bd9aca76 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:52.468970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351737-7fa5-4942-9503-0989ad5ff22f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.507849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:52.515354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded10100-9425-4cd3-87d9-e546c5c1eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.516130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded10100-9425-4cd3-87d9-e546c5c1eb0c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.516460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded10100-9425-4cd3-87d9-e546c5c1eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.516736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded10100-9425-4cd3-87d9-e546c5c1eb0c None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.517521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded10100-9425-4cd3-87d9-e546c5c1eb0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:52.518547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded10100-9425-4cd3-87d9-e546c5c1eb0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:52.519986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded10100-9425-4cd3-87d9-e546c5c1eb0c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:52.534426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 344/683] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:52.536107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e85c7-7c5e-4115-b2ce-51f68938e72b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.536616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e85c7-7c5e-4115-b2ce-51f68938e72b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.536888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e85c7-7c5e-4115-b2ce-51f68938e72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.556134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-059e85c7-7c5e-4115-b2ce-51f68938e72b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:52.557347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-059e85c7-7c5e-4115-b2ce-51f68938e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:52.563112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ada521-918e-41be-a675-1af8bd9aca76 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.602448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2681fe5-03e7-4a27-9b01-6393dea448cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.603682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2681fe5-03e7-4a27-9b01-6393dea448cd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.604219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2681fe5-03e7-4a27-9b01-6393dea448cd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.604753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2681fe5-03e7-4a27-9b01-6393dea448cd None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.606398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2681fe5-03e7-4a27-9b01-6393dea448cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:52.606916 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2681fe5-03e7-4a27-9b01-6393dea448cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:52.608431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:52.608843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2681fe5-03e7-4a27-9b01-6393dea448cd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:52.636704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 345/685] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:52.636930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 340/685] 10.222.0.15 () {56 vars in 1135 bytes} [Thu May 26 03:04:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:52.637563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e85c7-7c5e-4115-b2ce-51f68938e72b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:52.641827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2681fe5-03e7-4a27-9b01-6393dea448cd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:52.762333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e85c7-7c5e-4115-b2ce-51f68938e72b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.775283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2681fe5-03e7-4a27-9b01-6393dea448cd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.793965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:52.800148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccab1d5-d098-4041-94d3-bd1654630ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.800944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccab1d5-d098-4041-94d3-bd1654630ffc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.801297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccab1d5-d098-4041-94d3-bd1654630ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.801663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccab1d5-d098-4041-94d3-bd1654630ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.802710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccab1d5-d098-4041-94d3-bd1654630ffc None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=e22fe8105f01400ab6ac3dc14c7aa7f7) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:52.803178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccab1d5-d098-4041-94d3-bd1654630ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:52.804665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccab1d5-d098-4041-94d3-bd1654630ffc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:52.812048 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 346/686] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:52 2022] GET /identity/v3/role_assignments?user.id=e22fe8105f01400ab6ac3dc14c7aa7f7&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:52.813257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccab1d5-d098-4041-94d3-bd1654630ffc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:52.822109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bbaf3-066c-4a60-846d-424d8ca72a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.824280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bbaf3-066c-4a60-846d-424d8ca72a53 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.824830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bbaf3-066c-4a60-846d-424d8ca72a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.825289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bbaf3-066c-4a60-846d-424d8ca72a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.862237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:52.907065 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bbaf3-066c-4a60-846d-424d8ca72a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:52.908932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bbaf3-066c-4a60-846d-424d8ca72a53 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:52.936350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccab1d5-d098-4041-94d3-bd1654630ffc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:52.974252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130c027-2f55-4a90-b079-5ff5956c017a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:52.975082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c027-2f55-4a90-b079-5ff5956c017a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:52.975365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c027-2f55-4a90-b079-5ff5956c017a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:52.975640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c027-2f55-4a90-b079-5ff5956c017a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:52.988994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130c027-2f55-4a90-b079-5ff5956c017a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-4130c027-2f55-4a90-b079-5ff5956c017a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:52.997534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:52.998556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:52.999845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 347/687] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:53.005537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130c027-2f55-4a90-b079-5ff5956c017a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:53.119383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 341/688] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:53.129393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bbaf3-066c-4a60-846d-424d8ca72a53 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:53.132887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:53.138841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130c027-2f55-4a90-b079-5ff5956c017a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:53.146182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:53.186592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91a944-f9d1-4787-a682-5d7843974370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:53.187517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91a944-f9d1-4787-a682-5d7843974370 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:53.187632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91a944-f9d1-4787-a682-5d7843974370 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:53.187863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91a944-f9d1-4787-a682-5d7843974370 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:53.188658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91a944-f9d1-4787-a682-5d7843974370 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:53.189019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91a944-f9d1-4787-a682-5d7843974370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:53.190313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91a944-f9d1-4787-a682-5d7843974370 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:53.206475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 348/689] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:53.207424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91a944-f9d1-4787-a682-5d7843974370 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:53.250569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bbaf3-066c-4a60-846d-424d8ca72a53 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:53.322458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91a944-f9d1-4787-a682-5d7843974370 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:53.359212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478b7b5-91bc-4749-bc5b-3f3825f40a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:53.360124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478b7b5-91bc-4749-bc5b-3f3825f40a9b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:53.360444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478b7b5-91bc-4749-bc5b-3f3825f40a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:53.360730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478b7b5-91bc-4749-bc5b-3f3825f40a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:53.372496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478b7b5-91bc-4749-bc5b-3f3825f40a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:53.373885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478b7b5-91bc-4749-bc5b-3f3825f40a9b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:53.377705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefcaa5-fbf8-43e7-abb5-fbb5e6aae291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:53.378569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefcaa5-fbf8-43e7-abb5-fbb5e6aae291 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:53.378855 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefcaa5-fbf8-43e7-abb5-fbb5e6aae291 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:53.379131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefcaa5-fbf8-43e7-abb5-fbb5e6aae291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-0478b7b5-91bc-4749-bc5b-3f3825f40a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:53.393005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:53.393917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:53.394807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:53.394807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:53.394807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:53.394807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:53.394807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 349/690] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:53.398347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefcaa5-fbf8-43e7-abb5-fbb5e6aae291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:53.400750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478b7b5-91bc-4749-bc5b-3f3825f40a9b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:53.401458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefcaa5-fbf8-43e7-abb5-fbb5e6aae291 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:53.428555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cdefcaa5-fbf8-43e7-abb5-fbb5e6aae291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:53.435478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:53.436397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:53.437378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:53.437378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:53.437378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:53.437378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:53.448104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 342/691] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:53.453191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefcaa5-fbf8-43e7-abb5-fbb5e6aae291 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:53.562591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478b7b5-91bc-4749-bc5b-3f3825f40a9b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:53.603529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925cf0a-256e-4d73-8e33-d1f79fb55d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:53.604253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925cf0a-256e-4d73-8e33-d1f79fb55d09 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:53.604572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925cf0a-256e-4d73-8e33-d1f79fb55d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:53.604848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925cf0a-256e-4d73-8e33-d1f79fb55d09 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:53.606147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925cf0a-256e-4d73-8e33-d1f79fb55d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:53.606493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925cf0a-256e-4d73-8e33-d1f79fb55d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:53.607997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925cf0a-256e-4d73-8e33-d1f79fb55d09 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:53.625372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:53.637976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 350/692] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:53.645286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925cf0a-256e-4d73-8e33-d1f79fb55d09 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:53.684826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefcaa5-fbf8-43e7-abb5-fbb5e6aae291 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:53.749124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af955027-914f-4523-9e01-dc89041f7cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:53.749794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af955027-914f-4523-9e01-dc89041f7cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:53.750078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af955027-914f-4523-9e01-dc89041f7cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:53.750356 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af955027-914f-4523-9e01-dc89041f7cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:53.751126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af955027-914f-4523-9e01-dc89041f7cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:53.751438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af955027-914f-4523-9e01-dc89041f7cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:53.752854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af955027-914f-4523-9e01-dc89041f7cb4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:53.772649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 343/693] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:53.778457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af955027-914f-4523-9e01-dc89041f7cb4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:53.778980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:53.820693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925cf0a-256e-4d73-8e33-d1f79fb55d09 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:53.891648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa41047-5ae3-4b0e-ae62-e460169cd498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:53.893586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa41047-5ae3-4b0e-ae62-e460169cd498 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:53.893868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa41047-5ae3-4b0e-ae62-e460169cd498 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:53.894142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa41047-5ae3-4b0e-ae62-e460169cd498 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:53.909000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa41047-5ae3-4b0e-ae62-e460169cd498 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:53.910744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa41047-5ae3-4b0e-ae62-e460169cd498 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-daa41047-5ae3-4b0e-ae62-e460169cd498 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:53.945284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:53.946314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 03:04:53.947289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:53.955219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 351/694] 10.222.0.15 () {56 vars in 1093 bytes} [Thu May 26 03:04:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:53.957667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af955027-914f-4523-9e01-dc89041f7cb4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:53.963942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa41047-5ae3-4b0e-ae62-e460169cd498 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:54.022662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:54.057212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d8a28-3f00-415a-8377-2a5e87644a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:54.058596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8a28-3f00-415a-8377-2a5e87644a38 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.058885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8a28-3f00-415a-8377-2a5e87644a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.059158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8a28-3f00-415a-8377-2a5e87644a38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.068055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d8a28-3f00-415a-8377-2a5e87644a38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:54.078083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d8a28-3f00-415a-8377-2a5e87644a38 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-675d8a28-3f00-415a-8377-2a5e87644a38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:54.101482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:54.102468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:54.103421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:54.103421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:54.103421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:54.103421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:54.103421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:54.103421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:54.103421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:54.103421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:54.103421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 344/695] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:54.108631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d8a28-3f00-415a-8377-2a5e87644a38 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:54.133226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa41047-5ae3-4b0e-ae62-e460169cd498 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:54.203530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:54.213885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e76636-f7a0-4fd1-9c16-df566e0f5079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:54.214879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e76636-f7a0-4fd1-9c16-df566e0f5079 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.215171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e76636-f7a0-4fd1-9c16-df566e0f5079 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.215461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e76636-f7a0-4fd1-9c16-df566e0f5079 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.217017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e76636-f7a0-4fd1-9c16-df566e0f5079 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:54.217340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e76636-f7a0-4fd1-9c16-df566e0f5079 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:54.219396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e76636-f7a0-4fd1-9c16-df566e0f5079 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:54.229540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d8a28-3f00-415a-8377-2a5e87644a38 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:54.243267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 352/696] 10.222.0.15 () {56 vars in 1133 bytes} [Thu May 26 03:04:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:54.244982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0a98c-9eb5-4f4a-87c0-4e15b0741fc3 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.245280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0a98c-9eb5-4f4a-87c0-4e15b0741fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.246111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0a98c-9eb5-4f4a-87c0-4e15b0741fc3 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.252423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 353/697] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:54.256167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0a98c-9eb5-4f4a-87c0-4e15b0741fc3 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:54.278698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc220ad-2cb8-4061-88c9-14228366633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:54.279916 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc220ad-2cb8-4061-88c9-14228366633b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.280349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc220ad-2cb8-4061-88c9-14228366633b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.280785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc220ad-2cb8-4061-88c9-14228366633b None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.281832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc220ad-2cb8-4061-88c9-14228366633b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:54.282154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc220ad-2cb8-4061-88c9-14228366633b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:54.284333 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc220ad-2cb8-4061-88c9-14228366633b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:54.304354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 345/698] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:54.305724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413b44d-78da-4a58-aea4-686b04182092 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.306021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413b44d-78da-4a58-aea4-686b04182092 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.306304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413b44d-78da-4a58-aea4-686b04182092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.323477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e413b44d-78da-4a58-aea4-686b04182092 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:54.325279 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e413b44d-78da-4a58-aea4-686b04182092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:54.369380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:54.371028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0a98c-9eb5-4f4a-87c0-4e15b0741fc3 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:54.405096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 346/699] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:54.406009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413b44d-78da-4a58-aea4-686b04182092 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:54.409463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093fed2-2fd7-402c-b7f7-216d212a4121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:54.410175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093fed2-2fd7-402c-b7f7-216d212a4121 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.410466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093fed2-2fd7-402c-b7f7-216d212a4121 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.410745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093fed2-2fd7-402c-b7f7-216d212a4121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.488703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:54.504347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093fed2-2fd7-402c-b7f7-216d212a4121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:54.505784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093fed2-2fd7-402c-b7f7-216d212a4121 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:54.548539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413b44d-78da-4a58-aea4-686b04182092 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:54.588555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298eaf-592a-4845-813c-831549fcdf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:54.589215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298eaf-592a-4845-813c-831549fcdf95 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.590054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298eaf-592a-4845-813c-831549fcdf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.590333 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298eaf-592a-4845-813c-831549fcdf95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.591260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298eaf-592a-4845-813c-831549fcdf95 None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=80bd57e333be4921b6270b54a1fac2ef) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:54.591465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298eaf-592a-4845-813c-831549fcdf95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:54.592995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298eaf-592a-4845-813c-831549fcdf95 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:54.604697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 347/700] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:54 2022] GET /identity/v3/role_assignments?user.id=80bd57e333be4921b6270b54a1fac2ef&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:54.604697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298eaf-592a-4845-813c-831549fcdf95 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:54.676494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 354/701] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:54.678234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093fed2-2fd7-402c-b7f7-216d212a4121 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:54.687569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:54.804358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298eaf-592a-4845-813c-831549fcdf95 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:54.856112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:54.861766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bb759-b553-4a1f-a132-d0775912e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:54.862570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bb759-b553-4a1f-a132-d0775912e54f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.862855 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bb759-b553-4a1f-a132-d0775912e54f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.863287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bb759-b553-4a1f-a132-d0775912e54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.867284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093fed2-2fd7-402c-b7f7-216d212a4121 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:54.876467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bb759-b553-4a1f-a132-d0775912e54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:54.877880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bb759-b553-4a1f-a132-d0775912e54f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c95bb759-b553-4a1f-a132-d0775912e54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:54.900165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:54.901256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:54.902683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:54.902683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:54.902683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:54.902683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:54.902683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 348/702] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:54.902683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbe18-20bb-4c4f-afae-f925a589c16b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.903042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbe18-20bb-4c4f-afae-f925a589c16b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.903248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbe18-20bb-4c4f-afae-f925a589c16b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.904937 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 349/703] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:54.909347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcbe18-20bb-4c4f-afae-f925a589c16b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:54.919196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e1eda-512e-47ab-bb50-ba3a7e42fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:54.919985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e1eda-512e-47ab-bb50-ba3a7e42fc99 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.920263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e1eda-512e-47ab-bb50-ba3a7e42fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.920575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e1eda-512e-47ab-bb50-ba3a7e42fc99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.932891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e1eda-512e-47ab-bb50-ba3a7e42fc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:54.935152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e1eda-512e-47ab-bb50-ba3a7e42fc99 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a40e1eda-512e-47ab-bb50-ba3a7e42fc99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:54.956659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:54.957609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:54.958522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:54.958522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:54.958522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:54.958522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:54.960522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 355/704] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:54.963160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42500089-a6a3-4d58-8e86-df3d9333aa0d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:54.963667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42500089-a6a3-4d58-8e86-df3d9333aa0d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:54.964147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42500089-a6a3-4d58-8e86-df3d9333aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:54.981033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-42500089-a6a3-4d58-8e86-df3d9333aa0d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:54.982542 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-42500089-a6a3-4d58-8e86-df3d9333aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:55.029269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:55.042916 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcbe18-20bb-4c4f-afae-f925a589c16b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:55.073439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 356/705] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:55.076957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42500089-a6a3-4d58-8e86-df3d9333aa0d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:55.102596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b802e9-5751-4d80-8c92-0ff6c264bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:55.104604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b802e9-5751-4d80-8c92-0ff6c264bf6b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.105500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b802e9-5751-4d80-8c92-0ff6c264bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.105854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b802e9-5751-4d80-8c92-0ff6c264bf6b None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.106682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b802e9-5751-4d80-8c92-0ff6c264bf6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:55.107062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b802e9-5751-4d80-8c92-0ff6c264bf6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:55.108671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b802e9-5751-4d80-8c92-0ff6c264bf6b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:55.122021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 350/706] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:55.122970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b802e9-5751-4d80-8c92-0ff6c264bf6b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:55.169131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:55.201331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42500089-a6a3-4d58-8e86-df3d9333aa0d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:55.228202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b802e9-5751-4d80-8c92-0ff6c264bf6b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:55.238850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd0099-c8ca-4658-ac18-fc9d52226569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:55.239791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0099-c8ca-4658-ac18-fc9d52226569 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.240396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0099-c8ca-4658-ac18-fc9d52226569 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.240927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0099-c8ca-4658-ac18-fc9d52226569 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.241908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd0099-c8ca-4658-ac18-fc9d52226569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:55.242424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd0099-c8ca-4658-ac18-fc9d52226569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:55.244070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd0099-c8ca-4658-ac18-fc9d52226569 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:55.258705 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 357/707] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:55.260052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd0099-c8ca-4658-ac18-fc9d52226569 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:55.266841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4ac04-9399-4937-aa59-84e09e55eab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:55.267680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ac04-9399-4937-aa59-84e09e55eab0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.267968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ac04-9399-4937-aa59-84e09e55eab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.268243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ac04-9399-4937-aa59-84e09e55eab0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.268954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4ac04-9399-4937-aa59-84e09e55eab0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:55.270444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4ac04-9399-4937-aa59-84e09e55eab0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4eb4ac04-9399-4937-aa59-84e09e55eab0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:55.285720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:55.286767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 03:04:55.288095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:55.292900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 351/708] 10.222.0.15 () {56 vars in 1129 bytes} [Thu May 26 03:04:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:55.293781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4ac04-9399-4937-aa59-84e09e55eab0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:55.311017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:55.377716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd0099-c8ca-4658-ac18-fc9d52226569 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:55.399557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4ac04-9399-4937-aa59-84e09e55eab0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:55.410245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:55.416157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62158ff-7c40-40f5-90a4-b47f9928a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:55.417152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62158ff-7c40-40f5-90a4-b47f9928a6bc None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.418199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62158ff-7c40-40f5-90a4-b47f9928a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.418683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62158ff-7c40-40f5-90a4-b47f9928a6bc None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.419629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62158ff-7c40-40f5-90a4-b47f9928a6bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:55.421286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62158ff-7c40-40f5-90a4-b47f9928a6bc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:55.435856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722451c8-ba5c-4fa4-bc11-275e91f339f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:55.436780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722451c8-ba5c-4fa4-bc11-275e91f339f7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.437131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722451c8-ba5c-4fa4-bc11-275e91f339f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.437478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722451c8-ba5c-4fa4-bc11-275e91f339f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.444641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722451c8-ba5c-4fa4-bc11-275e91f339f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:55.446147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722451c8-ba5c-4fa4-bc11-275e91f339f7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-722451c8-ba5c-4fa4-bc11-275e91f339f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:04:55.460010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:55.461092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 352/709] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:55.462547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722451c8-ba5c-4fa4-bc11-275e91f339f7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:55.537991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:55.548398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 358/710] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:04:55 2022] POST /identity/v3/users => generated 254 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:04:55.548398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f68c2d-68b7-4f83-b7ed-ecbfee071557 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.548398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f68c2d-68b7-4f83-b7ed-ecbfee071557 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.548398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f68c2d-68b7-4f83-b7ed-ecbfee071557 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.548398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 359/711] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:55.548398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f68c2d-68b7-4f83-b7ed-ecbfee071557 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:55.569281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722451c8-ba5c-4fa4-bc11-275e91f339f7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:55.609838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835becd-d078-4e33-a106-f88325b4f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:55.610838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835becd-d078-4e33-a106-f88325b4f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.611297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835becd-d078-4e33-a106-f88325b4f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.611774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835becd-d078-4e33-a106-f88325b4f6d6 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.612813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835becd-d078-4e33-a106-f88325b4f6d6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:55.613333 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835becd-d078-4e33-a106-f88325b4f6d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:55.614954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835becd-d078-4e33-a106-f88325b4f6d6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:55.624782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 353/712] 10.222.0.15 () {56 vars in 1124 bytes} [Thu May 26 03:04:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:55.626658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87c78-11c3-4106-98a0-6e53d68154e3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.627188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87c78-11c3-4106-98a0-6e53d68154e3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.627675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87c78-11c3-4106-98a0-6e53d68154e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.646867 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a7d87c78-11c3-4106-98a0-6e53d68154e3 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:55.648474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a7d87c78-11c3-4106-98a0-6e53d68154e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:55.669135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f68c2d-68b7-4f83-b7ed-ecbfee071557 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:55.712300 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900c6db-7f34-4541-9a60-b08f4c20def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:55.714032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900c6db-7f34-4541-9a60-b08f4c20def9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.715421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900c6db-7f34-4541-9a60-b08f4c20def9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.715886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900c6db-7f34-4541-9a60-b08f4c20def9 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.717176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900c6db-7f34-4541-9a60-b08f4c20def9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:55.717506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900c6db-7f34-4541-9a60-b08f4c20def9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:55.719003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900c6db-7f34-4541-9a60-b08f4c20def9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:55.731778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 354/713] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:55.733120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87c78-11c3-4106-98a0-6e53d68154e3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:55.736374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 360/714] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:55.739894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900c6db-7f34-4541-9a60-b08f4c20def9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:55.803270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:55.833422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:55.867114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900c6db-7f34-4541-9a60-b08f4c20def9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:55.868245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87c78-11c3-4106-98a0-6e53d68154e3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:55.911851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557a7b8-4282-4720-bc70-674be63a2239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:55.912812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fba866-1844-402a-9989-b31f43277b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:55.913127 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a7b8-4282-4720-bc70-674be63a2239 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.913481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fba866-1844-402a-9989-b31f43277b44 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:55.913770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fba866-1844-402a-9989-b31f43277b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.914085 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fba866-1844-402a-9989-b31f43277b44 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.914317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a7b8-4282-4720-bc70-674be63a2239 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:55.914774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fba866-1844-402a-9989-b31f43277b44 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:55.914955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a7b8-4282-4720-bc70-674be63a2239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:55.915108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fba866-1844-402a-9989-b31f43277b44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:55.916161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557a7b8-4282-4720-bc70-674be63a2239 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=51f966be1d764324b7695e1caf578291) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:55.916516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fba866-1844-402a-9989-b31f43277b44 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:55.916956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557a7b8-4282-4720-bc70-674be63a2239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:55.918594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557a7b8-4282-4720-bc70-674be63a2239 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:55.923939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 355/715] 10.222.0.15 () {56 vars in 1124 bytes} [Thu May 26 03:04:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:55.924796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fba866-1844-402a-9989-b31f43277b44 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:55.925556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 361/716] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:04:55 2022] GET /identity/v3/role_assignments?user.id=51f966be1d764324b7695e1caf578291&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:56.095049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fba866-1844-402a-9989-b31f43277b44 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:56.139835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:56.146099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041113c7-fe1a-477f-9e38-9c3ef51514dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:56.153981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041113c7-fe1a-477f-9e38-9c3ef51514dd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:56.153981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041113c7-fe1a-477f-9e38-9c3ef51514dd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:56.153981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041113c7-fe1a-477f-9e38-9c3ef51514dd None admin] PATH_INFO: `/v3/services/network` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:56.153981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041113c7-fe1a-477f-9e38-9c3ef51514dd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:56.153981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041113c7-fe1a-477f-9e38-9c3ef51514dd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-041113c7-fe1a-477f-9e38-9c3ef51514dd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:56.165643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:56.166668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 03:04:56.167550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:56.170494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 356/717] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:04:55 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:56.176082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557a7b8-4282-4720-bc70-674be63a2239 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:56.306408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557a7b8-4282-4720-bc70-674be63a2239 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:56.328435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:56.354207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787be765-cd34-4d56-a9fb-f1262eef1568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:56.354944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787be765-cd34-4d56-a9fb-f1262eef1568 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:56.355228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787be765-cd34-4d56-a9fb-f1262eef1568 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:56.355500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787be765-cd34-4d56-a9fb-f1262eef1568 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:56.356202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787be765-cd34-4d56-a9fb-f1262eef1568 None admin] RBAC: Adding query filter params (name=network) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:56.356528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787be765-cd34-4d56-a9fb-f1262eef1568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:56.357879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787be765-cd34-4d56-a9fb-f1262eef1568 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:56.365581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 362/718] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:04:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:56.371213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041113c7-fe1a-477f-9e38-9c3ef51514dd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:56.507175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041113c7-fe1a-477f-9e38-9c3ef51514dd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:56.551091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486afc2-77c8-4a1c-8af9-8c06f5af1ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:56.551772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486afc2-77c8-4a1c-8af9-8c06f5af1ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:56.552059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486afc2-77c8-4a1c-8af9-8c06f5af1ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:56.552354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486afc2-77c8-4a1c-8af9-8c06f5af1ce5 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:56.553069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486afc2-77c8-4a1c-8af9-8c06f5af1ce5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:56.553377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486afc2-77c8-4a1c-8af9-8c06f5af1ce5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:56.554761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486afc2-77c8-4a1c-8af9-8c06f5af1ce5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:56.564405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 357/719] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:04:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:04:57.164112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e8aa0-0091-4dbf-ae37-fa3510517361 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:57.164646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e8aa0-0091-4dbf-ae37-fa3510517361 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:57.164646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e8aa0-0091-4dbf-ae37-fa3510517361 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:57.166279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 363/720] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:57.172078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0bf5f-ddee-4f5e-808e-6ca7f1d51829 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:57.172403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0bf5f-ddee-4f5e-808e-6ca7f1d51829 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:57.172693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0bf5f-ddee-4f5e-808e-6ca7f1d51829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:57.190187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-edb0bf5f-ddee-4f5e-808e-6ca7f1d51829 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:57.191378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-edb0bf5f-ddee-4f5e-808e-6ca7f1d51829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:57.249169 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:57.264425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 358/721] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 03:04:57.284549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e8aa0-0091-4dbf-ae37-fa3510517361 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:57.409067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e8aa0-0091-4dbf-ae37-fa3510517361 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:57.458992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905820c8-5b12-4b34-a6ac-449b3c4c11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:57.459770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905820c8-5b12-4b34-a6ac-449b3c4c11cd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:57.460062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905820c8-5b12-4b34-a6ac-449b3c4c11cd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:57.460357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905820c8-5b12-4b34-a6ac-449b3c4c11cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:57.473588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905820c8-5b12-4b34-a6ac-449b3c4c11cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-905820c8-5b12-4b34-a6ac-449b3c4c11cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:57.481904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:57.483106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:57.484176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 364/722] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:57.491264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0bf5f-ddee-4f5e-808e-6ca7f1d51829 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:57.656023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0bf5f-ddee-4f5e-808e-6ca7f1d51829 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:57.707847 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe06975-f3a2-4dc9-999a-8d3ae9e941e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:57.708553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06975-f3a2-4dc9-999a-8d3ae9e941e6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:57.708833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06975-f3a2-4dc9-999a-8d3ae9e941e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:57.709156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06975-f3a2-4dc9-999a-8d3ae9e941e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:57.709858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe06975-f3a2-4dc9-999a-8d3ae9e941e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:57.710162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe06975-f3a2-4dc9-999a-8d3ae9e941e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:57.711533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe06975-f3a2-4dc9-999a-8d3ae9e941e6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:57.724168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 359/723] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:57.729541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905820c8-5b12-4b34-a6ac-449b3c4c11cd None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:57.813355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:57.906406 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905820c8-5b12-4b34-a6ac-449b3c4c11cd None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:57.955331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c177c19-6f8e-442f-8603-d5dafd4a7cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:57.956119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c177c19-6f8e-442f-8603-d5dafd4a7cae None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:57.956419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c177c19-6f8e-442f-8603-d5dafd4a7cae None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:57.956698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c177c19-6f8e-442f-8603-d5dafd4a7cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:57.974251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c177c19-6f8e-442f-8603-d5dafd4a7cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:57.975677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c177c19-6f8e-442f-8603-d5dafd4a7cae None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-9c177c19-6f8e-442f-8603-d5dafd4a7cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:58.003215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:58.004267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:58.005207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:58.005207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:58.005207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:58.005207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:58.005207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 365/724] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:58.010565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe06975-f3a2-4dc9-999a-8d3ae9e941e6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:58.084242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:58.150432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe06975-f3a2-4dc9-999a-8d3ae9e941e6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:58.187373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af00106-4f24-49cd-89fd-0ca1a2b2108d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.187883 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af00106-4f24-49cd-89fd-0ca1a2b2108d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.187993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af00106-4f24-49cd-89fd-0ca1a2b2108d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.189548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 366/725] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:58.196012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bd1d7-e990-401f-82b6-7e96267ce9bc None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.196265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bd1d7-e990-401f-82b6-7e96267ce9bc None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.196799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bd1d7-e990-401f-82b6-7e96267ce9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.197232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538febb4-9f84-4078-be84-4424760eda5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:58.197903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538febb4-9f84-4078-be84-4424760eda5d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.198187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538febb4-9f84-4078-be84-4424760eda5d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.199011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538febb4-9f84-4078-be84-4424760eda5d None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.199746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538febb4-9f84-4078-be84-4424760eda5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:58.200060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538febb4-9f84-4078-be84-4424760eda5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:58.202892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538febb4-9f84-4078-be84-4424760eda5d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:58.226909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 360/726] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:58.228777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-424bd1d7-e990-401f-82b6-7e96267ce9bc None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:58.230223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-424bd1d7-e990-401f-82b6-7e96267ce9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:58.232199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538febb4-9f84-4078-be84-4424760eda5d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:58.361745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 367/727] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:58.372259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538febb4-9f84-4078-be84-4424760eda5d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:58.388949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:58.397613 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bd1d7-e990-401f-82b6-7e96267ce9bc None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:58.426555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:58.434787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc353-b7a2-4c0c-ba4b-8c8f3bb802b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:58.435873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc353-b7a2-4c0c-ba4b-8c8f3bb802b3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.436161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc353-b7a2-4c0c-ba4b-8c8f3bb802b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.436471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc353-b7a2-4c0c-ba4b-8c8f3bb802b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.453051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bc353-b7a2-4c0c-ba4b-8c8f3bb802b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:58.459482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bc353-b7a2-4c0c-ba4b-8c8f3bb802b3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-273bc353-b7a2-4c0c-ba4b-8c8f3bb802b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:58.488224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:58.489410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 03:04:58.490615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:58.500087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 361/728] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:58.503331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc353-b7a2-4c0c-ba4b-8c8f3bb802b3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:58.595770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bd1d7-e990-401f-82b6-7e96267ce9bc None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:58.665599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b54e6-66ae-4eb4-8616-9bdae37b8d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:58.666682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b54e6-66ae-4eb4-8616-9bdae37b8d2c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.667121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b54e6-66ae-4eb4-8616-9bdae37b8d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.667577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b54e6-66ae-4eb4-8616-9bdae37b8d2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.691313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b54e6-66ae-4eb4-8616-9bdae37b8d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-7e2b54e6-66ae-4eb4-8616-9bdae37b8d2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:58.700982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:58.702101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:04:58.703157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:58.706153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 368/729] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:04:58.712489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc353-b7a2-4c0c-ba4b-8c8f3bb802b3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:58.717247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b54e6-66ae-4eb4-8616-9bdae37b8d2c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:58.758932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8869d50-f296-4687-af25-85ddaa67a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:58.759865 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8869d50-f296-4687-af25-85ddaa67a8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.760300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8869d50-f296-4687-af25-85ddaa67a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.762185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8869d50-f296-4687-af25-85ddaa67a8d7 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.763212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8869d50-f296-4687-af25-85ddaa67a8d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:58.763679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8869d50-f296-4687-af25-85ddaa67a8d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:58.766904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8869d50-f296-4687-af25-85ddaa67a8d7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:58.790813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 362/730] 10.222.0.15 () {56 vars in 1135 bytes} [Thu May 26 03:04:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:58.792918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d4bdb-7f7f-4999-8ee7-747392c131aa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.793431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d4bdb-7f7f-4999-8ee7-747392c131aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.793944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d4bdb-7f7f-4999-8ee7-747392c131aa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.796334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 363/731] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:58.797760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db101a9f-ce98-4c5e-adae-fa826b08acf4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.798274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db101a9f-ce98-4c5e-adae-fa826b08acf4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.798755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db101a9f-ce98-4c5e-adae-fa826b08acf4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.800539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 364/732] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:58.801468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db101a9f-ce98-4c5e-adae-fa826b08acf4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:58.835131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:58.837870 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:58.860132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b54e6-66ae-4eb4-8616-9bdae37b8d2c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:58.893626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf406bca-7dfe-426e-8ed3-6b12310a5af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:58.894299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf406bca-7dfe-426e-8ed3-6b12310a5af6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.894584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf406bca-7dfe-426e-8ed3-6b12310a5af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.894857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf406bca-7dfe-426e-8ed3-6b12310a5af6 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.897435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf406bca-7dfe-426e-8ed3-6b12310a5af6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:58.897435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf406bca-7dfe-426e-8ed3-6b12310a5af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:58.897435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf406bca-7dfe-426e-8ed3-6b12310a5af6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:58.909556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 369/733] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:58.909556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5471b-b627-42fd-bd3a-d78014a65704 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.909556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5471b-b627-42fd-bd3a-d78014a65704 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.909556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5471b-b627-42fd-bd3a-d78014a65704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:58.914974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db101a9f-ce98-4c5e-adae-fa826b08acf4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:58.924728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-36b5471b-b627-42fd-bd3a-d78014a65704 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:58.925911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-36b5471b-b627-42fd-bd3a-d78014a65704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:58.954118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a842a2-3555-49c0-b5e9-fa6f7fd3d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:58.954880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a842a2-3555-49c0-b5e9-fa6f7fd3d7ee None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:58.955168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a842a2-3555-49c0-b5e9-fa6f7fd3d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:58.955450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a842a2-3555-49c0-b5e9-fa6f7fd3d7ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.003520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 370/734] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:59.003520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73c2b7-08b8-4c13-bc42-f934b033a812 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.003520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73c2b7-08b8-4c13-bc42-f934b033a812 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.003520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73c2b7-08b8-4c13-bc42-f934b033a812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.014467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0f73c2b7-08b8-4c13-bc42-f934b033a812 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:59.015576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0f73c2b7-08b8-4c13-bc42-f934b033a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:59.035981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a842a2-3555-49c0-b5e9-fa6f7fd3d7ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:59.038135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a842a2-3555-49c0-b5e9-fa6f7fd3d7ee None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:59.067585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:59.081296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:59.092338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 371/735] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:04:59.092338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73c2b7-08b8-4c13-bc42-f934b033a812 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:59.160047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 365/736] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 03:04:59.161313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a842a2-3555-49c0-b5e9-fa6f7fd3d7ee None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:59.200672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73c2b7-08b8-4c13-bc42-f934b033a812 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:59.240196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fe941-47d9-4c36-b95b-ab156d2ec1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:59.241020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fe941-47d9-4c36-b95b-ab156d2ec1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.241313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fe941-47d9-4c36-b95b-ab156d2ec1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.241954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fe941-47d9-4c36-b95b-ab156d2ec1f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.255069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fe941-47d9-4c36-b95b-ab156d2ec1f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:59.257145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fe941-47d9-4c36-b95b-ab156d2ec1f0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:59.263613 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a842a2-3555-49c0-b5e9-fa6f7fd3d7ee None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-048fe941-47d9-4c36-b95b-ab156d2ec1f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:59.279786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:59.281012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:59.281927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:59.281927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:59.281927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:59.281927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:59.281927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 372/737] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:59.282223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fe941-47d9-4c36-b95b-ab156d2ec1f0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:59.298226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:59.303806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ba85-d7ff-4dc8-9a46-d5647681018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:59.304700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ba85-d7ff-4dc8-9a46-d5647681018a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.304985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ba85-d7ff-4dc8-9a46-d5647681018a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.305329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ba85-d7ff-4dc8-9a46-d5647681018a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289ba85-d7ff-4dc8-9a46-d5647681018a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2289ba85-d7ff-4dc8-9a46-d5647681018a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:59.325841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:59.326682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:59.327591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 366/738] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:04:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:59.328453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ba85-d7ff-4dc8-9a46-d5647681018a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:59.344726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:59.399492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fe941-47d9-4c36-b95b-ab156d2ec1f0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:59.435274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d3b9a-9289-429d-b124-d4fa79284277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:59.435939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d3b9a-9289-429d-b124-d4fa79284277 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.436221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d3b9a-9289-429d-b124-d4fa79284277 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.436524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d3b9a-9289-429d-b124-d4fa79284277 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.437237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d3b9a-9289-429d-b124-d4fa79284277 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:59.438592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d3b9a-9289-429d-b124-d4fa79284277 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:59.441059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ba85-d7ff-4dc8-9a46-d5647681018a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:59.476126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b1ddd-24c7-4f19-ae29-e050919b3876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:59.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b1ddd-24c7-4f19-ae29-e050919b3876 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.477212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b1ddd-24c7-4f19-ae29-e050919b3876 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.477484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b1ddd-24c7-4f19-ae29-e050919b3876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.488199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b1ddd-24c7-4f19-ae29-e050919b3876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:59.489684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b1ddd-24c7-4f19-ae29-e050919b3876 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-999b1ddd-24c7-4f19-ae29-e050919b3876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:04:59.506657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:59.517463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:59.518398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:04:59.518398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:04:59.518398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:04:59.518398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:04:59.518398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 367/739] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:59.518398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b1ddd-24c7-4f19-ae29-e050919b3876 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:59.522756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 373/740] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:04:59 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:04:59.523773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d3b9a-9289-429d-b124-d4fa79284277 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:59.574896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:59.648954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b1ddd-24c7-4f19-ae29-e050919b3876 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:59.671073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d3b9a-9289-429d-b124-d4fa79284277 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:59.681870 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:59.690581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f158f-d3f9-45e3-99b1-d6e535618c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:59.691655 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f158f-d3f9-45e3-99b1-d6e535618c3d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.692158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f158f-d3f9-45e3-99b1-d6e535618c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.692679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f158f-d3f9-45e3-99b1-d6e535618c3d None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.693647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f158f-d3f9-45e3-99b1-d6e535618c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:59.694164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f158f-d3f9-45e3-99b1-d6e535618c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:59.695748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f158f-d3f9-45e3-99b1-d6e535618c3d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:59.709062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 368/741] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:59.709228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85699842-c606-4723-adb1-ffd9ebeed464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:59.709713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f158f-d3f9-45e3-99b1-d6e535618c3d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:59.709823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85699842-c606-4723-adb1-ffd9ebeed464 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.710100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85699842-c606-4723-adb1-ffd9ebeed464 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.710378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85699842-c606-4723-adb1-ffd9ebeed464 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.711122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85699842-c606-4723-adb1-ffd9ebeed464 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:59.711426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85699842-c606-4723-adb1-ffd9ebeed464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:59.713126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85699842-c606-4723-adb1-ffd9ebeed464 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:59.723810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 374/742] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:04:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:59.728399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91254f7-ff47-486f-9a54-38b909d997c4 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.728399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91254f7-ff47-486f-9a54-38b909d997c4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.728399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91254f7-ff47-486f-9a54-38b909d997c4 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.731868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 375/743] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:04:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:04:59.732654 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91254f7-ff47-486f-9a54-38b909d997c4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:59.823705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f158f-d3f9-45e3-99b1-d6e535618c3d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:59.826548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:59.846294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91254f7-ff47-486f-9a54-38b909d997c4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:04:59.862629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd7623-6f76-4da7-a8ba-4938811ab2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:59.863413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd7623-6f76-4da7-a8ba-4938811ab2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.863799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd7623-6f76-4da7-a8ba-4938811ab2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.864070 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd7623-6f76-4da7-a8ba-4938811ab2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.864923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd7623-6f76-4da7-a8ba-4938811ab2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:04:59.865232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd7623-6f76-4da7-a8ba-4938811ab2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:59.866593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd7623-6f76-4da7-a8ba-4938811ab2b0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:59.883577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 369/744] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:04:59.883577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd7623-6f76-4da7-a8ba-4938811ab2b0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:04:59.886380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f570806-4e04-4787-bc8d-25b1ec47494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:04:59.887192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f570806-4e04-4787-bc8d-25b1ec47494d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.887470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f570806-4e04-4787-bc8d-25b1ec47494d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.887758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f570806-4e04-4787-bc8d-25b1ec47494d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.895455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f570806-4e04-4787-bc8d-25b1ec47494d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:04:59.896918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f570806-4e04-4787-bc8d-25b1ec47494d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-9f570806-4e04-4787-bc8d-25b1ec47494d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:04:59.912563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:04:59.913538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:04:59.914534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 376/745] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:04:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:04:59.915140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5dcc9-54d8-480f-abf8-de7410e074a2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:04:59.915140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5dcc9-54d8-480f-abf8-de7410e074a2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:04:59.915775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5dcc9-54d8-480f-abf8-de7410e074a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:04:59.932036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-67e5dcc9-54d8-480f-abf8-de7410e074a2 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:04:59.933288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-67e5dcc9-54d8-480f-abf8-de7410e074a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:04:59.957253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:04:59.993866 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd7623-6f76-4da7-a8ba-4938811ab2b0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:00.003100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 377/746] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:04:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 03:05:00.004261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5dcc9-54d8-480f-abf8-de7410e074a2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:00.048294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfaa43-9014-41a9-952b-813279ce7cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:00.049628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfaa43-9014-41a9-952b-813279ce7cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:00.050005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfaa43-9014-41a9-952b-813279ce7cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:00.050390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfaa43-9014-41a9-952b-813279ce7cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:00.061599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfaa43-9014-41a9-952b-813279ce7cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:00.063053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfaa43-9014-41a9-952b-813279ce7cb7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-24dfaa43-9014-41a9-952b-813279ce7cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:00.079995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:00.081129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:00.082340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:00.082340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:00.082340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:00.082340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:00.085669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 370/747] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:00.086523 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfaa43-9014-41a9-952b-813279ce7cb7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:00.102935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:00.113482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5dcc9-54d8-480f-abf8-de7410e074a2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:00.149592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4143e0f-aab6-4e8d-b38c-e26e03755576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:00.150678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4143e0f-aab6-4e8d-b38c-e26e03755576 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:00.151143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4143e0f-aab6-4e8d-b38c-e26e03755576 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:00.152110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4143e0f-aab6-4e8d-b38c-e26e03755576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:00.159427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4143e0f-aab6-4e8d-b38c-e26e03755576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:00.161062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4143e0f-aab6-4e8d-b38c-e26e03755576 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e4143e0f-aab6-4e8d-b38c-e26e03755576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:00.175440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:00.176541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:00.177623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:00.177623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:00.177623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:00.177623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:00.177623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:00.177623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:00.177623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:00.177623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:00.179538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 378/748] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:00.180575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4143e0f-aab6-4e8d-b38c-e26e03755576 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:00.194706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfaa43-9014-41a9-952b-813279ce7cb7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:00.204049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:00.231200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362791-b7b5-4c44-bcc4-d1e1c98247d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:00.231873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362791-b7b5-4c44-bcc4-d1e1c98247d7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:00.232160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362791-b7b5-4c44-bcc4-d1e1c98247d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:00.232472 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362791-b7b5-4c44-bcc4-d1e1c98247d7 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:00.233318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a362791-b7b5-4c44-bcc4-d1e1c98247d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:00.233644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a362791-b7b5-4c44-bcc4-d1e1c98247d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:00.235081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a362791-b7b5-4c44-bcc4-d1e1c98247d7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:00.257649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 371/749] 10.222.0.15 () {56 vars in 1149 bytes} [Thu May 26 03:05:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:00.257649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362791-b7b5-4c44-bcc4-d1e1c98247d7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:00.284266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4143e0f-aab6-4e8d-b38c-e26e03755576 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:00.318183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac936f19-2e61-4e9f-8764-55df8a9379ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:00.318854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac936f19-2e61-4e9f-8764-55df8a9379ba None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:00.319139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac936f19-2e61-4e9f-8764-55df8a9379ba None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:00.319460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac936f19-2e61-4e9f-8764-55df8a9379ba None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:00.320132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac936f19-2e61-4e9f-8764-55df8a9379ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:00.321523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac936f19-2e61-4e9f-8764-55df8a9379ba None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:00.331234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:00.360727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362791-b7b5-4c44-bcc4-d1e1c98247d7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:00.400337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 379/750] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:05:00 2022] POST /identity/v3/services => generated 240 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:00.400337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac936f19-2e61-4e9f-8764-55df8a9379ba None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:00.411857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a696f-559a-464d-9fb2-90317e95f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:00.412774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a696f-559a-464d-9fb2-90317e95f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:00.413053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a696f-559a-464d-9fb2-90317e95f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:00.413328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a696f-559a-464d-9fb2-90317e95f1c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:00.414187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a696f-559a-464d-9fb2-90317e95f1c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:00.414501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a696f-559a-464d-9fb2-90317e95f1c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:00.415973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a696f-559a-464d-9fb2-90317e95f1c8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:00.429977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 372/751] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:00.431004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a696f-559a-464d-9fb2-90317e95f1c8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:00.507589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:00.538782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac936f19-2e61-4e9f-8764-55df8a9379ba None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:00.557493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a696f-559a-464d-9fb2-90317e95f1c8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:00.588531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:00.595810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f71750-5ef5-4529-8b97-c7127ee945fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:00.596954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f71750-5ef5-4529-8b97-c7127ee945fe None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:00.597609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f71750-5ef5-4529-8b97-c7127ee945fe None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:00.598068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f71750-5ef5-4529-8b97-c7127ee945fe None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:00.598827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf10b5-e6e3-4f19-96bc-0b234833c7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:00.599226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f71750-5ef5-4529-8b97-c7127ee945fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:00.599685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf10b5-e6e3-4f19-96bc-0b234833c7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:00.599846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f71750-5ef5-4529-8b97-c7127ee945fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:00.600153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf10b5-e6e3-4f19-96bc-0b234833c7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:00.600573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf10b5-e6e3-4f19-96bc-0b234833c7d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:00.601849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f71750-5ef5-4529-8b97-c7127ee945fe None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:00.621659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 380/752] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:00.622852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f71750-5ef5-4529-8b97-c7127ee945fe None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:00.692190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf10b5-e6e3-4f19-96bc-0b234833c7d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:00.693717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf10b5-e6e3-4f19-96bc-0b234833c7d8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:00.755922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f71750-5ef5-4529-8b97-c7127ee945fe None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:00.797044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c783b5-b88c-45f4-b760-232c12e4adfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:00.797959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c783b5-b88c-45f4-b760-232c12e4adfa None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:00.798226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c783b5-b88c-45f4-b760-232c12e4adfa None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:00.798508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c783b5-b88c-45f4-b760-232c12e4adfa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:00.808341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c783b5-b88c-45f4-b760-232c12e4adfa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:00.809779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c783b5-b88c-45f4-b760-232c12e4adfa None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:00.813336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:00.821449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 373/753] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:05:00.822507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf10b5-e6e3-4f19-96bc-0b234833c7d8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-18c783b5-b88c-45f4-b760-232c12e4adfa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:00.837164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:00.838380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 381/754] 10.222.0.15 () {56 vars in 1093 bytes} [Thu May 26 03:05:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:00.839748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c783b5-b88c-45f4-b760-232c12e4adfa None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:00.864528 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:00.967712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c783b5-b88c-45f4-b760-232c12e4adfa None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:00.971206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf10b5-e6e3-4f19-96bc-0b234833c7d8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:01.009996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba2718-1998-4827-b274-6019b86080e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:01.011665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba2718-1998-4827-b274-6019b86080e0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.012129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba2718-1998-4827-b274-6019b86080e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.012611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba2718-1998-4827-b274-6019b86080e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.013506 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f78dc-284b-4ff5-aabd-6703b3ce510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:01.014305 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f78dc-284b-4ff5-aabd-6703b3ce510e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.014654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f78dc-284b-4ff5-aabd-6703b3ce510e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.015008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f78dc-284b-4ff5-aabd-6703b3ce510e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.016557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f78dc-284b-4ff5-aabd-6703b3ce510e None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=80bd57e333be4921b6270b54a1fac2ef) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:01.016947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f78dc-284b-4ff5-aabd-6703b3ce510e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:01.018448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f78dc-284b-4ff5-aabd-6703b3ce510e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:01.025306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 374/755] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:00 2022] GET /identity/v3/role_assignments?user.id=80bd57e333be4921b6270b54a1fac2ef&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:01.027202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f78dc-284b-4ff5-aabd-6703b3ce510e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:01.034162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba2718-1998-4827-b274-6019b86080e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:01.035965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba2718-1998-4827-b274-6019b86080e0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e0ba2718-1998-4827-b274-6019b86080e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:01.069149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:01.070188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:01.071097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:01.071097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:01.071097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:01.071097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:01.071097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 382/756] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:01.077510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba2718-1998-4827-b274-6019b86080e0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:01.144758 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:01.154324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f78dc-284b-4ff5-aabd-6703b3ce510e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:01.196784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4aae4-b50e-44ab-8def-7f61a208bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:01.197850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4aae4-b50e-44ab-8def-7f61a208bca4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.198405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4aae4-b50e-44ab-8def-7f61a208bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.198884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4aae4-b50e-44ab-8def-7f61a208bca4 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.199946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4aae4-b50e-44ab-8def-7f61a208bca4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:01.200508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4aae4-b50e-44ab-8def-7f61a208bca4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:01.202391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4aae4-b50e-44ab-8def-7f61a208bca4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:01.212719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:01.245828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 375/757] 10.222.0.15 () {56 vars in 1133 bytes} [Thu May 26 03:05:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:01.251144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4aae4-b50e-44ab-8def-7f61a208bca4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:01.288986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba2718-1998-4827-b274-6019b86080e0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:01.355229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2c523-1772-412c-aa0e-2369cfe8efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:01.355903 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2c523-1772-412c-aa0e-2369cfe8efc9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.356189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2c523-1772-412c-aa0e-2369cfe8efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.360679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2c523-1772-412c-aa0e-2369cfe8efc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.361436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2c523-1772-412c-aa0e-2369cfe8efc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:01.361753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2c523-1772-412c-aa0e-2369cfe8efc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:01.363151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2c523-1772-412c-aa0e-2369cfe8efc9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:01.389651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 383/758] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:01.395243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2c523-1772-412c-aa0e-2369cfe8efc9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:01.430691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4aae4-b50e-44ab-8def-7f61a208bca4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:01.472744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795e7a-cc60-4646-9778-73dede9d8596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:01.473541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795e7a-cc60-4646-9778-73dede9d8596 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.473823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795e7a-cc60-4646-9778-73dede9d8596 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.474092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795e7a-cc60-4646-9778-73dede9d8596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.486185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795e7a-cc60-4646-9778-73dede9d8596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:01.487636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795e7a-cc60-4646-9778-73dede9d8596 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4d795e7a-cc60-4646-9778-73dede9d8596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:01.507572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:01.508533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:01.509440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:01.509440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:01.509440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:01.509440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:01.509440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 376/759] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:01.518694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795e7a-cc60-4646-9778-73dede9d8596 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:01.522560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:01.606389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2c523-1772-412c-aa0e-2369cfe8efc9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:01.625979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:01.647216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783dadd-0a11-469f-aa55-568c66563d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:01.648358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783dadd-0a11-469f-aa55-568c66563d7c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.648848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783dadd-0a11-469f-aa55-568c66563d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.649327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783dadd-0a11-469f-aa55-568c66563d7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.657154 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783dadd-0a11-469f-aa55-568c66563d7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:01.658880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783dadd-0a11-469f-aa55-568c66563d7c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6783dadd-0a11-469f-aa55-568c66563d7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:01.674415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:01.675408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:01.676524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:01.676524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:01.676524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:01.676524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:01.676524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:01.676524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:01.676524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:01.676524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:01.679948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 384/760] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:01.697862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783dadd-0a11-469f-aa55-568c66563d7c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:01.699434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795e7a-cc60-4646-9778-73dede9d8596 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:01.745696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c196c08-4eb0-4b22-aed0-5457c2c65dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:01.746427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c196c08-4eb0-4b22-aed0-5457c2c65dce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.746699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c196c08-4eb0-4b22-aed0-5457c2c65dce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.746970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c196c08-4eb0-4b22-aed0-5457c2c65dce None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.747701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c196c08-4eb0-4b22-aed0-5457c2c65dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:01.748005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c196c08-4eb0-4b22-aed0-5457c2c65dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:01.749439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c196c08-4eb0-4b22-aed0-5457c2c65dce None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:01.768347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 377/761] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:01.770051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c196c08-4eb0-4b22-aed0-5457c2c65dce None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:01.849512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783dadd-0a11-469f-aa55-568c66563d7c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:01.851693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:01.918516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c196c08-4eb0-4b22-aed0-5457c2c65dce None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:01.927329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b256ff9-3324-481c-b4d2-33e3da2fbb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:01.928069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256ff9-3324-481c-b4d2-33e3da2fbb39 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.928465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256ff9-3324-481c-b4d2-33e3da2fbb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.928827 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256ff9-3324-481c-b4d2-33e3da2fbb39 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.930080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b256ff9-3324-481c-b4d2-33e3da2fbb39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:01.930798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b256ff9-3324-481c-b4d2-33e3da2fbb39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:01.932563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b256ff9-3324-481c-b4d2-33e3da2fbb39 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:01.950377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 385/762] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:01.952145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e294f-0b64-4df1-af42-31aea98686d6 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.952465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e294f-0b64-4df1-af42-31aea98686d6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.952793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e294f-0b64-4df1-af42-31aea98686d6 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.958025 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 386/763] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:01.958025 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e294f-0b64-4df1-af42-31aea98686d6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:01.959917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd51c1-d08f-4992-b919-a862ace575f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:01.960871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd51c1-d08f-4992-b919-a862ace575f2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:01.961245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd51c1-d08f-4992-b919-a862ace575f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:01.961871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd51c1-d08f-4992-b919-a862ace575f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:01.973017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd51c1-d08f-4992-b919-a862ace575f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:01.974814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd51c1-d08f-4992-b919-a862ace575f2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:01.989731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1afd51c1-d08f-4992-b919-a862ace575f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:01.993823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:01.994772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:01.995738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:01.995738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:01.995738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:01.995738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:01.995738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:01.995738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:01.995738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:01.995738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:02.000141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 378/764] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:02.009195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd9a27-9346-4b17-bed2-c3e62c84899f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:02.009195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd9a27-9346-4b17-bed2-c3e62c84899f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:02.009195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd9a27-9346-4b17-bed2-c3e62c84899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:02.019693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-66bd9a27-9346-4b17-bed2-c3e62c84899f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:02.020626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-66bd9a27-9346-4b17-bed2-c3e62c84899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:02.079915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e294f-0b64-4df1-af42-31aea98686d6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:02.100558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 379/765] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:02.101550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd9a27-9346-4b17-bed2-c3e62c84899f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:02.121351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd0fca-0454-4e66-ba1e-4c8113f62af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:02.122385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd0fca-0454-4e66-ba1e-4c8113f62af6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:02.122867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd0fca-0454-4e66-ba1e-4c8113f62af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:02.123395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd0fca-0454-4e66-ba1e-4c8113f62af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:02.124729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd0fca-0454-4e66-ba1e-4c8113f62af6 None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=c3df8c2dd7194952abaa8658bbacd56f) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:02.125242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd0fca-0454-4e66-ba1e-4c8113f62af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:02.127089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd0fca-0454-4e66-ba1e-4c8113f62af6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:02.134723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 387/766] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:01 2022] GET /identity/v3/role_assignments?user.id=c3df8c2dd7194952abaa8658bbacd56f&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:02.136539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd0fca-0454-4e66-ba1e-4c8113f62af6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:02.175393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:02.278480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd9a27-9346-4b17-bed2-c3e62c84899f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:02.306104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:02.314255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd0fca-0454-4e66-ba1e-4c8113f62af6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:02.337570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcda88a-f4d4-4255-8c4e-9f05dfd0a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:02.338249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcda88a-f4d4-4255-8c4e-9f05dfd0a513 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:02.338529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcda88a-f4d4-4255-8c4e-9f05dfd0a513 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:02.338799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcda88a-f4d4-4255-8c4e-9f05dfd0a513 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:02.339625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcda88a-f4d4-4255-8c4e-9f05dfd0a513 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:02.339933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcda88a-f4d4-4255-8c4e-9f05dfd0a513 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:02.341730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcda88a-f4d4-4255-8c4e-9f05dfd0a513 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:02.368741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 380/767] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:02.376345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcda88a-f4d4-4255-8c4e-9f05dfd0a513 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:02.394114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbfd3-f64f-4d7a-8abb-ee712ef7dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:02.394934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbfd3-f64f-4d7a-8abb-ee712ef7dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:02.395237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbfd3-f64f-4d7a-8abb-ee712ef7dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:02.396240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbfd3-f64f-4d7a-8abb-ee712ef7dcd1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:02.396495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbfd3-f64f-4d7a-8abb-ee712ef7dcd1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:02.397858 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbfd3-f64f-4d7a-8abb-ee712ef7dcd1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-30acbfd3-f64f-4d7a-8abb-ee712ef7dcd1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:02.417446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:02.418449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 03:05:02.419291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:02.421598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 388/768] 10.222.0.15 () {56 vars in 1129 bytes} [Thu May 26 03:05:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:02.424432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbfd3-f64f-4d7a-8abb-ee712ef7dcd1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:02.538195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbfd3-f64f-4d7a-8abb-ee712ef7dcd1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:02.581043 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23ed02-c3b7-48ed-880c-f979f324ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:02.581723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23ed02-c3b7-48ed-880c-f979f324ddbd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:02.582011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23ed02-c3b7-48ed-880c-f979f324ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:02.582287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23ed02-c3b7-48ed-880c-f979f324ddbd None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:02.583003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23ed02-c3b7-48ed-880c-f979f324ddbd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:02.583311 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23ed02-c3b7-48ed-880c-f979f324ddbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:02.584708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23ed02-c3b7-48ed-880c-f979f324ddbd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:02.593942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcda88a-f4d4-4255-8c4e-9f05dfd0a513 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:02.594472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 389/769] 10.222.0.15 () {56 vars in 1124 bytes} [Thu May 26 03:05:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:02.605796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23ed02-c3b7-48ed-880c-f979f324ddbd None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:02.612564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:02.640024 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea585595-0acb-4371-a1e2-840e128b5b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:02.642616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea585595-0acb-4371-a1e2-840e128b5b2a None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:02.642910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea585595-0acb-4371-a1e2-840e128b5b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:02.643188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea585595-0acb-4371-a1e2-840e128b5b2a None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/51f966be1d764324b7695e1caf578291/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:02.647191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea585595-0acb-4371-a1e2-840e128b5b2a None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=51f966be1d764324b7695e1caf578291, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:02.648673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea585595-0acb-4371-a1e2-840e128b5b2a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:02.660685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:02.738649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23ed02-c3b7-48ed-880c-f979f324ddbd None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:02.764405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 381/770] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:05:02 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/51f966be1d764324b7695e1caf578291/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:05:02.791885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c155273-2c1d-4ebb-88e2-71706f112623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:02.793468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c155273-2c1d-4ebb-88e2-71706f112623 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:02.793948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c155273-2c1d-4ebb-88e2-71706f112623 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:02.794417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c155273-2c1d-4ebb-88e2-71706f112623 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:02.795410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c155273-2c1d-4ebb-88e2-71706f112623 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:02.795944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c155273-2c1d-4ebb-88e2-71706f112623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:02.797566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c155273-2c1d-4ebb-88e2-71706f112623 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:02.811836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 390/771] 10.222.0.15 () {56 vars in 1124 bytes} [Thu May 26 03:05:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:02.817487 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea585595-0acb-4371-a1e2-840e128b5b2a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:02.944458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea585595-0acb-4371-a1e2-840e128b5b2a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:02.989448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2221a35-2b40-4191-bfe3-c2b18a7165a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:02.990468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2221a35-2b40-4191-bfe3-c2b18a7165a1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:02.990987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2221a35-2b40-4191-bfe3-c2b18a7165a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:02.991459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2221a35-2b40-4191-bfe3-c2b18a7165a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:02.992484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2221a35-2b40-4191-bfe3-c2b18a7165a1 None admin] RBAC: Adding query filter params (interface=public, service_id=d592ecd80ddb4d8fb22ddf307ee1fb5c, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:02.993009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2221a35-2b40-4191-bfe3-c2b18a7165a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:02.994589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2221a35-2b40-4191-bfe3-c2b18a7165a1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:03.008019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 382/772] 10.222.0.15 () {56 vars in 1251 bytes} [Thu May 26 03:05:02 2022] GET /identity/v3/endpoints?service_id=d592ecd80ddb4d8fb22ddf307ee1fb5c&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:03.009965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7973818-e37c-4a10-8970-3ee9a4f82a0a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:03.010482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7973818-e37c-4a10-8970-3ee9a4f82a0a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:03.010988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7973818-e37c-4a10-8970-3ee9a4f82a0a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:03.015987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2221a35-2b40-4191-bfe3-c2b18a7165a1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:03.016333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 391/773] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:03.017994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988714e-db86-4f4c-9206-fd70c298bc4e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:03.018382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988714e-db86-4f4c-9206-fd70c298bc4e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:03.018756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988714e-db86-4f4c-9206-fd70c298bc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:03.039827 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9988714e-db86-4f4c-9206-fd70c298bc4e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:03.041355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9988714e-db86-4f4c-9206-fd70c298bc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:03.055524 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:03.124435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 392/774] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:03.143979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988714e-db86-4f4c-9206-fd70c298bc4e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:03.154599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2221a35-2b40-4191-bfe3-c2b18a7165a1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:03.168688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:03.218008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8732c-9b75-464c-8af6-47500ce81a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:03.218690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8732c-9b75-464c-8af6-47500ce81a9e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:03.218977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8732c-9b75-464c-8af6-47500ce81a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:03.219253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8732c-9b75-464c-8af6-47500ce81a9e None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:03.219941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8732c-9b75-464c-8af6-47500ce81a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:03.221360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8732c-9b75-464c-8af6-47500ce81a9e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:03.235039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 383/775] 10.222.0.15 () {56 vars in 1087 bytes} [Thu May 26 03:05:03 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:03.249134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988714e-db86-4f4c-9206-fd70c298bc4e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:03.287056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb9a23-486c-4d21-98a1-80b7611d12e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:03.287857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb9a23-486c-4d21-98a1-80b7611d12e5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:03.288134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb9a23-486c-4d21-98a1-80b7611d12e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:03.288434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb9a23-486c-4d21-98a1-80b7611d12e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:03.289084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb9a23-486c-4d21-98a1-80b7611d12e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:03.290460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb9a23-486c-4d21-98a1-80b7611d12e5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-43cb9a23-486c-4d21-98a1-80b7611d12e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:03.302940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:03.304017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 03:05:03.304879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:03.308485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 393/776] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:03 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:03.313439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8732c-9b75-464c-8af6-47500ce81a9e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:03.460047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8732c-9b75-464c-8af6-47500ce81a9e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:03.468682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:03.501629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d9fcb-ac79-487a-8491-8d0c6e5b2e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:03.502340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d9fcb-ac79-487a-8491-8d0c6e5b2e26 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:03.502625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d9fcb-ac79-487a-8491-8d0c6e5b2e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:03.502902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d9fcb-ac79-487a-8491-8d0c6e5b2e26 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:03.503653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d9fcb-ac79-487a-8491-8d0c6e5b2e26 None admin] RBAC: Adding query filter params (name=network) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:03.503969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d9fcb-ac79-487a-8491-8d0c6e5b2e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:03.505575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d9fcb-ac79-487a-8491-8d0c6e5b2e26 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:03.512093 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 384/777] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:03.518115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb9a23-486c-4d21-98a1-80b7611d12e5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:03.608716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:03.626834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb9a23-486c-4d21-98a1-80b7611d12e5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:03.666215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d9df1-1170-47c3-acd1-31bc2c2a8599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:03.666901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d9df1-1170-47c3-acd1-31bc2c2a8599 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:03.667188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d9df1-1170-47c3-acd1-31bc2c2a8599 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:03.667460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d9df1-1170-47c3-acd1-31bc2c2a8599 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:03.668158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d9df1-1170-47c3-acd1-31bc2c2a8599 None admin] RBAC: Adding query filter params (type=network) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:03.668494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d9df1-1170-47c3-acd1-31bc2c2a8599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:03.669854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d9df1-1170-47c3-acd1-31bc2c2a8599 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:03.678772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 394/778] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:03.681434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d9fcb-ac79-487a-8491-8d0c6e5b2e26 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:03.756760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12cf9-036c-4729-b10e-c71e39310fd4 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:03.757069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12cf9-036c-4729-b10e-c71e39310fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:03.757314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12cf9-036c-4729-b10e-c71e39310fd4 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:03.758799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 395/779] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:03.771764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543cddb-1e47-4b09-98b3-0c795ddb13d8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:03.772052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543cddb-1e47-4b09-98b3-0c795ddb13d8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:03.772354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543cddb-1e47-4b09-98b3-0c795ddb13d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:03.805082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a543cddb-1e47-4b09-98b3-0c795ddb13d8 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:03.806438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a543cddb-1e47-4b09-98b3-0c795ddb13d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:03.812983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d9fcb-ac79-487a-8491-8d0c6e5b2e26 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:03.852234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab927d-a87a-461e-9497-1a3b17713eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:03.852933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab927d-a87a-461e-9497-1a3b17713eeb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:03.853218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab927d-a87a-461e-9497-1a3b17713eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:03.853493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab927d-a87a-461e-9497-1a3b17713eeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:03.854282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab927d-a87a-461e-9497-1a3b17713eeb None admin] RBAC: Adding query filter params (interface=public, service_id=f235b0c25a944543b203316b2ad3ee9e, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:03.854621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab927d-a87a-461e-9497-1a3b17713eeb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:03.856772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab927d-a87a-461e-9497-1a3b17713eeb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:03.865988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 385/780] 10.222.0.15 () {56 vars in 1251 bytes} [Thu May 26 03:05:03 2022] GET /identity/v3/endpoints?service_id=f235b0c25a944543b203316b2ad3ee9e&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:03.872895 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab927d-a87a-461e-9497-1a3b17713eeb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:03.904345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:03.969837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 396/781] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:03.979200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab927d-a87a-461e-9497-1a3b17713eeb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:04.019607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af31327-ff5f-42da-ba80-e21129fe3d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:04.020549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af31327-ff5f-42da-ba80-e21129fe3d72 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:04.020813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af31327-ff5f-42da-ba80-e21129fe3d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:04.021103 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af31327-ff5f-42da-ba80-e21129fe3d72 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:04.021794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af31327-ff5f-42da-ba80-e21129fe3d72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:04.022362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543cddb-1e47-4b09-98b3-0c795ddb13d8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:04.023212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af31327-ff5f-42da-ba80-e21129fe3d72 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:04.029049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 386/782] 10.222.0.15 () {56 vars in 1087 bytes} [Thu May 26 03:05:03 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:04.147211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:04.171911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543cddb-1e47-4b09-98b3-0c795ddb13d8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:04.220623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10940de3-ba90-4b22-b970-9d667591c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:04.221444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10940de3-ba90-4b22-b970-9d667591c049 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:04.221725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10940de3-ba90-4b22-b970-9d667591c049 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:04.221990 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10940de3-ba90-4b22-b970-9d667591c049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:04.241465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10940de3-ba90-4b22-b970-9d667591c049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-10940de3-ba90-4b22-b970-9d667591c049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:04.249596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:04.250555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:04.251420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 397/783] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:04.256755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af31327-ff5f-42da-ba80-e21129fe3d72 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:04.407210 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:04.417153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af31327-ff5f-42da-ba80-e21129fe3d72 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:04.469915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fccef1-7bc0-4eef-a44d-bd35bdc1cda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:04.470648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fccef1-7bc0-4eef-a44d-bd35bdc1cda7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:04.470932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fccef1-7bc0-4eef-a44d-bd35bdc1cda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:04.471206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fccef1-7bc0-4eef-a44d-bd35bdc1cda7 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:04.471960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fccef1-7bc0-4eef-a44d-bd35bdc1cda7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:04.472264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fccef1-7bc0-4eef-a44d-bd35bdc1cda7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:04.473657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fccef1-7bc0-4eef-a44d-bd35bdc1cda7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:04.487904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 387/784] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:04.493148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10940de3-ba90-4b22-b970-9d667591c049 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:04.635099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10940de3-ba90-4b22-b970-9d667591c049 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:04.678258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ea1b-7dd4-4fa7-918d-9609cb37d916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:04.678973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ea1b-7dd4-4fa7-918d-9609cb37d916 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:04.679256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ea1b-7dd4-4fa7-918d-9609cb37d916 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:04.679533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ea1b-7dd4-4fa7-918d-9609cb37d916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:04.687352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:04.691198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143ea1b-7dd4-4fa7-918d-9609cb37d916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:04.692694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143ea1b-7dd4-4fa7-918d-9609cb37d916 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8143ea1b-7dd4-4fa7-918d-9609cb37d916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:04.710532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:04.711719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:04.712691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:04.712691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:04.712691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:04.712691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:04.712691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 398/785] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:04.717946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fccef1-7bc0-4eef-a44d-bd35bdc1cda7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:04.850322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fccef1-7bc0-4eef-a44d-bd35bdc1cda7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:04.885227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944fea-8180-4fb6-849e-254f8855c13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:04.885925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944fea-8180-4fb6-849e-254f8855c13c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:04.886211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944fea-8180-4fb6-849e-254f8855c13c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:04.886488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944fea-8180-4fb6-849e-254f8855c13c None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:04.887223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944fea-8180-4fb6-849e-254f8855c13c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:04.887533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944fea-8180-4fb6-849e-254f8855c13c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:04.888997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944fea-8180-4fb6-849e-254f8855c13c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:04.905619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 388/786] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:04.911266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ea1b-7dd4-4fa7-918d-9609cb37d916 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:04.922971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797443d-bdc0-447e-8b70-722d74c2b537 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:04.923276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797443d-bdc0-447e-8b70-722d74c2b537 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:04.923537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797443d-bdc0-447e-8b70-722d74c2b537 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:04.926934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 389/787] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:04.929901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d8d74-e59a-485e-9195-19a633dba9ab None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:04.930130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d8d74-e59a-485e-9195-19a633dba9ab None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:04.930414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d8d74-e59a-485e-9195-19a633dba9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:04.947658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-205d8d74-e59a-485e-9195-19a633dba9ab None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:04.948911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-205d8d74-e59a-485e-9195-19a633dba9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:04.963929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:05.063663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 390/788] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:05.087275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d8d74-e59a-485e-9195-19a633dba9ab None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:05.096723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ea1b-7dd4-4fa7-918d-9609cb37d916 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:05.155634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef526a8-9e83-4127-978d-52134c25c206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:05.156453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef526a8-9e83-4127-978d-52134c25c206 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:05.156743 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef526a8-9e83-4127-978d-52134c25c206 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:05.157017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef526a8-9e83-4127-978d-52134c25c206 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:05.174310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef526a8-9e83-4127-978d-52134c25c206 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:05.175756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef526a8-9e83-4127-978d-52134c25c206 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-aef526a8-9e83-4127-978d-52134c25c206 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:05.198495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:05.199468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 03:05:05.200448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:05.201482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 399/789] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:05:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:05.210947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef526a8-9e83-4127-978d-52134c25c206 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:05.244904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d8d74-e59a-485e-9195-19a633dba9ab None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:05.283103 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85eff1-2b53-4417-a52b-420a209c380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:05.284301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85eff1-2b53-4417-a52b-420a209c380c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:05.284711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85eff1-2b53-4417-a52b-420a209c380c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:05.285092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85eff1-2b53-4417-a52b-420a209c380c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:05.300184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85eff1-2b53-4417-a52b-420a209c380c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:05.301688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3a85eff1-2b53-4417-a52b-420a209c380c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:05.314269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:05.315499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:05:05.316560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:05.319529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 391/790] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:05.324917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85eff1-2b53-4417-a52b-420a209c380c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:05.330190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:05.394283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef526a8-9e83-4127-978d-52134c25c206 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:05.462994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f5605-91b3-48ff-af8e-d5214c17001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:05.463588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f5605-91b3-48ff-af8e-d5214c17001e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:05.463901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f5605-91b3-48ff-af8e-d5214c17001e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:05.464272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f5605-91b3-48ff-af8e-d5214c17001e None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:05.465230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f5605-91b3-48ff-af8e-d5214c17001e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:05.465545 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f5605-91b3-48ff-af8e-d5214c17001e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:05.467073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f5605-91b3-48ff-af8e-d5214c17001e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:05.470597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85eff1-2b53-4417-a52b-420a209c380c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:05.504134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 400/791] 10.222.0.15 () {56 vars in 1135 bytes} [Thu May 26 03:05:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:05.504687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bf6a8-dc84-48c0-a3dc-d2916314d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:05.505284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bf6a8-dc84-48c0-a3dc-d2916314d285 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:05.505455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bf6a8-dc84-48c0-a3dc-d2916314d285 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:05.505738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bf6a8-dc84-48c0-a3dc-d2916314d285 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:05.506475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bf6a8-dc84-48c0-a3dc-d2916314d285 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:05.506777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bf6a8-dc84-48c0-a3dc-d2916314d285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:05.508150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bf6a8-dc84-48c0-a3dc-d2916314d285 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:05.509861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf270a5-4570-43b1-b5dd-8a37404bb4a0 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:05.510153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf270a5-4570-43b1-b5dd-8a37404bb4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:05.510430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf270a5-4570-43b1-b5dd-8a37404bb4a0 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:05.512377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 401/792] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:05.513234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf270a5-4570-43b1-b5dd-8a37404bb4a0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:05.517692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 392/793] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:05.523360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8c994-eae2-4c80-9d1f-91ab52d6b49b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:05.523652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8c994-eae2-4c80-9d1f-91ab52d6b49b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:05.523929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8c994-eae2-4c80-9d1f-91ab52d6b49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:05.542325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bef8c994-eae2-4c80-9d1f-91ab52d6b49b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:05.543504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bef8c994-eae2-4c80-9d1f-91ab52d6b49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:05.607625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:05.615392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 393/794] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:05.616376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8c994-eae2-4c80-9d1f-91ab52d6b49b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:05.640075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf270a5-4570-43b1-b5dd-8a37404bb4a0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:05.652375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:05.684092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b773-347a-4101-9a65-db01acf93841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:05.684921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b773-347a-4101-9a65-db01acf93841 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:05.685198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b773-347a-4101-9a65-db01acf93841 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:05.685466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b773-347a-4101-9a65-db01acf93841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:05.704074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b773-347a-4101-9a65-db01acf93841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:05.706122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b773-347a-4101-9a65-db01acf93841 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1800b773-347a-4101-9a65-db01acf93841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:05.726783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:05.727715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:05.729230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:05.729230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:05.729230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:05.729230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:05.732418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 402/795] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:05.733259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b773-347a-4101-9a65-db01acf93841 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:05.755273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8c994-eae2-4c80-9d1f-91ab52d6b49b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:05.799356 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f56c8-10de-4530-9581-8b9f30de166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:05.800633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f56c8-10de-4530-9581-8b9f30de166d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:05.801008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f56c8-10de-4530-9581-8b9f30de166d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:05.801658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f56c8-10de-4530-9581-8b9f30de166d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:05.816882 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f56c8-10de-4530-9581-8b9f30de166d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:05.818757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f56c8-10de-4530-9581-8b9f30de166d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3c9f56c8-10de-4530-9581-8b9f30de166d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:05.843096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:05.844083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:05.845030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:05.845030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:05.845030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:05.845030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:05.848393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 394/796] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:05.849451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f56c8-10de-4530-9581-8b9f30de166d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:05.857491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b773-347a-4101-9a65-db01acf93841 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:05.901641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444de0-c31a-4448-ac5c-9c29a104fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:05.902508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444de0-c31a-4448-ac5c-9c29a104fb09 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:05.902794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444de0-c31a-4448-ac5c-9c29a104fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:05.903065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444de0-c31a-4448-ac5c-9c29a104fb09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:05.915059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:05.921710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444de0-c31a-4448-ac5c-9c29a104fb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8f444de0-c31a-4448-ac5c-9c29a104fb09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:05.932593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:05.933616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:05.934470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:05.939222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 403/797] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:05.940249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444de0-c31a-4448-ac5c-9c29a104fb09 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:05.968064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:05.980030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f56c8-10de-4530-9581-8b9f30de166d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.016245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdd2ad-bf5d-433c-8cc0-a73452da665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.017468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdd2ad-bf5d-433c-8cc0-a73452da665c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.018021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdd2ad-bf5d-433c-8cc0-a73452da665c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.018493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdd2ad-bf5d-433c-8cc0-a73452da665c None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.019404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdd2ad-bf5d-433c-8cc0-a73452da665c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:06.020012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdd2ad-bf5d-433c-8cc0-a73452da665c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.021807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdd2ad-bf5d-433c-8cc0-a73452da665c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.039609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 395/798] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:06.040858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdd2ad-bf5d-433c-8cc0-a73452da665c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.070850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444de0-c31a-4448-ac5c-9c29a104fb09 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.114747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5a75-3d35-4a13-bc1f-c07cdccdd666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.115414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5a75-3d35-4a13-bc1f-c07cdccdd666 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.115694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5a75-3d35-4a13-bc1f-c07cdccdd666 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.115968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5a75-3d35-4a13-bc1f-c07cdccdd666 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.116714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5a75-3d35-4a13-bc1f-c07cdccdd666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:06.117017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5a75-3d35-4a13-bc1f-c07cdccdd666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.118373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5a75-3d35-4a13-bc1f-c07cdccdd666 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.129975 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 404/799] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:06.130779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5a75-3d35-4a13-bc1f-c07cdccdd666 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.154840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdd2ad-bf5d-433c-8cc0-a73452da665c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.165033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:06.191991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35038b95-3da3-46cb-8451-4e5eb9f9d2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.192792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35038b95-3da3-46cb-8451-4e5eb9f9d2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.193073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35038b95-3da3-46cb-8451-4e5eb9f9d2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.193351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35038b95-3da3-46cb-8451-4e5eb9f9d2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.194087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35038b95-3da3-46cb-8451-4e5eb9f9d2c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:06.194448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35038b95-3da3-46cb-8451-4e5eb9f9d2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.195983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35038b95-3da3-46cb-8451-4e5eb9f9d2c3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.209338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 396/800] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:06.209338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afb9dc-35d8-4c17-87b4-3ca8909a8622 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.209338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afb9dc-35d8-4c17-87b4-3ca8909a8622 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.209338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afb9dc-35d8-4c17-87b4-3ca8909a8622 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.213412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 397/801] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:06.214680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afb9dc-35d8-4c17-87b4-3ca8909a8622 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.214781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:06.238324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5a75-3d35-4a13-bc1f-c07cdccdd666 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.274411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c05d97-04bc-4317-b2f1-3973e52f8bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.275340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c05d97-04bc-4317-b2f1-3973e52f8bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.275616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c05d97-04bc-4317-b2f1-3973e52f8bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.275910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c05d97-04bc-4317-b2f1-3973e52f8bd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.283962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c05d97-04bc-4317-b2f1-3973e52f8bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.285471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c05d97-04bc-4317-b2f1-3973e52f8bd4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-74c05d97-04bc-4317-b2f1-3973e52f8bd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:06.300411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:06.301337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 405/802] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:06.307097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c05d97-04bc-4317-b2f1-3973e52f8bd4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.324450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afb9dc-35d8-4c17-87b4-3ca8909a8622 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.359767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8d10-1672-421e-a08e-e3fc625ecd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.360712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8d10-1672-421e-a08e-e3fc625ecd29 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.361000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8d10-1672-421e-a08e-e3fc625ecd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.361280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8d10-1672-421e-a08e-e3fc625ecd29 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.368693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f8d10-1672-421e-a08e-e3fc625ecd29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.370176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f8d10-1672-421e-a08e-e3fc625ecd29 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-609f8d10-1672-421e-a08e-e3fc625ecd29 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:06.385171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:06.386641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:06.387645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:06.391386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 398/803] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:06.392658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7109626-408f-4f19-95be-88f919104046 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.392976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7109626-408f-4f19-95be-88f919104046 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.393230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7109626-408f-4f19-95be-88f919104046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.409951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b7109626-408f-4f19-95be-88f919104046 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:06.411139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b7109626-408f-4f19-95be-88f919104046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:06.411335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c05d97-04bc-4317-b2f1-3973e52f8bd4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.434885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:06.449120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8efd4-0153-4ebb-aa5a-ccef4c62578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.450130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8efd4-0153-4ebb-aa5a-ccef4c62578e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.450555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8efd4-0153-4ebb-aa5a-ccef4c62578e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.450980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8efd4-0153-4ebb-aa5a-ccef4c62578e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.458538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:06.462663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8efd4-0153-4ebb-aa5a-ccef4c62578e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.464756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8efd4-0153-4ebb-aa5a-ccef4c62578e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.488626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 399/804] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:06.488626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7109626-408f-4f19-95be-88f919104046 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-80b8efd4-0153-4ebb-aa5a-ccef4c62578e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:06.488866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:06.489755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:06.490632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:06.490632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:06.490632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:06.490632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:06.490632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 406/805] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:06.490632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8efd4-0153-4ebb-aa5a-ccef4c62578e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.600908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7109626-408f-4f19-95be-88f919104046 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.604055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8efd4-0153-4ebb-aa5a-ccef4c62578e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.638265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9015d-9c9a-4ea4-8984-eee75b8f5fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.638944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9015d-9c9a-4ea4-8984-eee75b8f5fdb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.639226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9015d-9c9a-4ea4-8984-eee75b8f5fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.639505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9015d-9c9a-4ea4-8984-eee75b8f5fdb None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.640374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9015d-9c9a-4ea4-8984-eee75b8f5fdb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:06.640654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af373cf5-ab4d-42a4-8766-4eb38ae61f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.640777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9015d-9c9a-4ea4-8984-eee75b8f5fdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.641308 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af373cf5-ab4d-42a4-8766-4eb38ae61f6b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.641591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af373cf5-ab4d-42a4-8766-4eb38ae61f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.641864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af373cf5-ab4d-42a4-8766-4eb38ae61f6b None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.642100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9015d-9c9a-4ea4-8984-eee75b8f5fdb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.642641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af373cf5-ab4d-42a4-8766-4eb38ae61f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:06.642946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af373cf5-ab4d-42a4-8766-4eb38ae61f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.644366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af373cf5-ab4d-42a4-8766-4eb38ae61f6b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.656625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 400/806] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:06.657501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af373cf5-ab4d-42a4-8766-4eb38ae61f6b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.665207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 407/807] 10.222.0.15 () {56 vars in 1149 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:06.666286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9015d-9c9a-4ea4-8984-eee75b8f5fdb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.684100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:06.718244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:06.762013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af373cf5-ab4d-42a4-8766-4eb38ae61f6b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.767736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9015d-9c9a-4ea4-8984-eee75b8f5fdb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.794807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27462402-5464-43fc-a614-ce68bf026e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.795495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27462402-5464-43fc-a614-ce68bf026e04 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.795778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27462402-5464-43fc-a614-ce68bf026e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.796050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27462402-5464-43fc-a614-ce68bf026e04 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.796805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27462402-5464-43fc-a614-ce68bf026e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:06.797110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27462402-5464-43fc-a614-ce68bf026e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.798485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27462402-5464-43fc-a614-ce68bf026e04 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.803665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9e4b-927a-41ce-89a7-117209ca6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.804504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9e4b-927a-41ce-89a7-117209ca6657 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.804788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9e4b-927a-41ce-89a7-117209ca6657 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.805063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9e4b-927a-41ce-89a7-117209ca6657 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.805713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9e4b-927a-41ce-89a7-117209ca6657 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.807052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9e4b-927a-41ce-89a7-117209ca6657 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.810706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 401/808] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:06.811626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27462402-5464-43fc-a614-ce68bf026e04 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1d0a9e4b-927a-41ce-89a7-117209ca6657 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:06.824625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:06.827293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:06.828151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 408/809] 10.222.0.15 () {56 vars in 1129 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:06.829380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9e4b-927a-41ce-89a7-117209ca6657 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:06.897628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:06.915775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27462402-5464-43fc-a614-ce68bf026e04 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.925658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9e4b-927a-41ce-89a7-117209ca6657 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:06.938741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:06.949663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c745f47-cfab-4a91-9e2a-8556d05d1568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.950545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c745f47-cfab-4a91-9e2a-8556d05d1568 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.952541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c745f47-cfab-4a91-9e2a-8556d05d1568 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.952541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c745f47-cfab-4a91-9e2a-8556d05d1568 None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/80bd57e333be4921b6270b54a1fac2ef/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.953135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c745f47-cfab-4a91-9e2a-8556d05d1568 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=80bd57e333be4921b6270b54a1fac2ef, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.954575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c745f47-cfab-4a91-9e2a-8556d05d1568 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.959701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2ee4-bbbe-4f32-95af-22857bb3854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:06.960519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2ee4-bbbe-4f32-95af-22857bb3854e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.960813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2ee4-bbbe-4f32-95af-22857bb3854e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.961281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2ee4-bbbe-4f32-95af-22857bb3854e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.971768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c2ee4-bbbe-4f32-95af-22857bb3854e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:06.973210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c2ee4-bbbe-4f32-95af-22857bb3854e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6d5c2ee4-bbbe-4f32-95af-22857bb3854e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:06.990307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:06.991371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:06.992426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:06.992426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:06.992426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:06.992426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:06.992426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 409/810] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:06.992723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18394-2d58-473a-ae4f-555ffe8c7861 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:06.992941 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18394-2d58-473a-ae4f-555ffe8c7861 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:06.993174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18394-2d58-473a-ae4f-555ffe8c7861 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:06.994411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 410/811] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:06.995625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a18394-2d58-473a-ae4f-555ffe8c7861 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:07.013485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 402/812] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:05:06 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/80bd57e333be4921b6270b54a1fac2ef/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:05:07.014535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c745f47-cfab-4a91-9e2a-8556d05d1568 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:07.114091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a18394-2d58-473a-ae4f-555ffe8c7861 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:07.137403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c745f47-cfab-4a91-9e2a-8556d05d1568 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:07.158610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ac277-5ee2-41f6-a4f0-f3ad1eed8361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:07.159553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ac277-5ee2-41f6-a4f0-f3ad1eed8361 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.159844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ac277-5ee2-41f6-a4f0-f3ad1eed8361 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.160167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ac277-5ee2-41f6-a4f0-f3ad1eed8361 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.168869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ac277-5ee2-41f6-a4f0-f3ad1eed8361 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:07.170321 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ac277-5ee2-41f6-a4f0-f3ad1eed8361 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:07.177682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5648adc-c0bc-4b45-9448-596020ea7cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:07.178676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5648adc-c0bc-4b45-9448-596020ea7cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.179171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5648adc-c0bc-4b45-9448-596020ea7cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.179594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5648adc-c0bc-4b45-9448-596020ea7cc8 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.180684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5648adc-c0bc-4b45-9448-596020ea7cc8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:07.181186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5648adc-c0bc-4b45-9448-596020ea7cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:07.183471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5648adc-c0bc-4b45-9448-596020ea7cc8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6b2ac277-5ee2-41f6-a4f0-f3ad1eed8361 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:07.186474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:07.187619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 411/813] 10.222.0.15 () {56 vars in 1093 bytes} [Thu May 26 03:05:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:07.188638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ac277-5ee2-41f6-a4f0-f3ad1eed8361 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:07.195595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 403/814] 10.222.0.15 () {56 vars in 1124 bytes} [Thu May 26 03:05:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:07.197204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cb68-547e-4390-8e69-d0a74c8258a4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.197493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cb68-547e-4390-8e69-d0a74c8258a4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.197771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cb68-547e-4390-8e69-d0a74c8258a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.206417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:07.216711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8ba9cb68-547e-4390-8e69-d0a74c8258a4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:07.218081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8ba9cb68-547e-4390-8e69-d0a74c8258a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:07.248682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:07.292275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 404/815] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:07.293508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cb68-547e-4390-8e69-d0a74c8258a4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:07.310916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ac277-5ee2-41f6-a4f0-f3ad1eed8361 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:07.363065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97934-0b52-4ca9-8f50-10a4d0c238e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:07.363788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97934-0b52-4ca9-8f50-10a4d0c238e2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.364075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97934-0b52-4ca9-8f50-10a4d0c238e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.364420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97934-0b52-4ca9-8f50-10a4d0c238e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.365165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae97934-0b52-4ca9-8f50-10a4d0c238e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:07.365453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae97934-0b52-4ca9-8f50-10a4d0c238e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:07.366806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae97934-0b52-4ca9-8f50-10a4d0c238e2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:07.386749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 412/816] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:07.387536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97934-0b52-4ca9-8f50-10a4d0c238e2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:07.446343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cb68-547e-4390-8e69-d0a74c8258a4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:07.490021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02dbb-f3dd-4a79-847e-3baba71a731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:07.490695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02dbb-f3dd-4a79-847e-3baba71a731f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.490981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02dbb-f3dd-4a79-847e-3baba71a731f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.491255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02dbb-f3dd-4a79-847e-3baba71a731f None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.492090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02dbb-f3dd-4a79-847e-3baba71a731f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:07.492450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02dbb-f3dd-4a79-847e-3baba71a731f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:07.493885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02dbb-f3dd-4a79-847e-3baba71a731f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:07.496248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:07.512860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:07.521911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 405/817] 10.222.0.15 () {56 vars in 1133 bytes} [Thu May 26 03:05:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:07.521911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02dbb-f3dd-4a79-847e-3baba71a731f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:07.536363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97934-0b52-4ca9-8f50-10a4d0c238e2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:07.577569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77a77b-dc04-49a4-8025-dfa1a9374d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:07.578165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77a77b-dc04-49a4-8025-dfa1a9374d0b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.578610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77a77b-dc04-49a4-8025-dfa1a9374d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.578729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77a77b-dc04-49a4-8025-dfa1a9374d0b None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.579421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77a77b-dc04-49a4-8025-dfa1a9374d0b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:07.579739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77a77b-dc04-49a4-8025-dfa1a9374d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:07.581106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77a77b-dc04-49a4-8025-dfa1a9374d0b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:07.591250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 413/818] 10.222.0.15 () {56 vars in 1124 bytes} [Thu May 26 03:05:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:07.591250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77a77b-dc04-49a4-8025-dfa1a9374d0b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:07.645154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02dbb-f3dd-4a79-847e-3baba71a731f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:07.687151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b244fe-4ef8-4dbd-a082-91bd99508a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:07.687950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b244fe-4ef8-4dbd-a082-91bd99508a2d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.688232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b244fe-4ef8-4dbd-a082-91bd99508a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.688541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b244fe-4ef8-4dbd-a082-91bd99508a2d None admin] PATH_INFO: `/v3/services/network` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.689250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b244fe-4ef8-4dbd-a082-91bd99508a2d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:07.690585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b244fe-4ef8-4dbd-a082-91bd99508a2d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-80b244fe-4ef8-4dbd-a082-91bd99508a2d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:07.702815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:07.703881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:07.705414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 406/819] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:07 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:07.706224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b244fe-4ef8-4dbd-a082-91bd99508a2d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:07.716556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77a77b-dc04-49a4-8025-dfa1a9374d0b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:07.753541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5de35f-7b94-43d8-a516-fcf8b25824d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:07.754629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5de35f-7b94-43d8-a516-fcf8b25824d8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.755099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5de35f-7b94-43d8-a516-fcf8b25824d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.755373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5de35f-7b94-43d8-a516-fcf8b25824d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.763640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5de35f-7b94-43d8-a516-fcf8b25824d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:07.765188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5de35f-7b94-43d8-a516-fcf8b25824d8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:07.768986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-cd5de35f-7b94-43d8-a516-fcf8b25824d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:07.779582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:07.786739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 414/820] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:07.787641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5de35f-7b94-43d8-a516-fcf8b25824d8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:07.796088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:07.827776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b244fe-4ef8-4dbd-a082-91bd99508a2d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:07.866033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecab486-ff68-4381-be2d-94cff2a6b444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:07.866682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecab486-ff68-4381-be2d-94cff2a6b444 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.867236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecab486-ff68-4381-be2d-94cff2a6b444 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.867236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecab486-ff68-4381-be2d-94cff2a6b444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.891663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5de35f-7b94-43d8-a516-fcf8b25824d8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:07.927663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f849b-7459-4bd4-b21f-1d972e0e9c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:07.928344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f849b-7459-4bd4-b21f-1d972e0e9c7e None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:07.928640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f849b-7459-4bd4-b21f-1d972e0e9c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:07.928922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f849b-7459-4bd4-b21f-1d972e0e9c7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:07.929655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f849b-7459-4bd4-b21f-1d972e0e9c7e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:07.931010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f849b-7459-4bd4-b21f-1d972e0e9c7e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:07.936841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecab486-ff68-4381-be2d-94cff2a6b444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:07.938284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecab486-ff68-4381-be2d-94cff2a6b444 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:07.993663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:08.019107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 415/821] 10.222.0.15 () {60 vars in 1144 bytes} [Thu May 26 03:05:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:08.019928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f849b-7459-4bd4-b21f-1d972e0e9c7e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:08.050449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 407/822] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:05:08.051585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecab486-ff68-4381-be2d-94cff2a6b444 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:08.112091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:08.173530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecab486-ff68-4381-be2d-94cff2a6b444 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:08.175280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f849b-7459-4bd4-b21f-1d972e0e9c7e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:08.212698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007950d-8405-4736-9c8e-aba55287be7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:08.213488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007950d-8405-4736-9c8e-aba55287be7c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:08.213821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007950d-8405-4736-9c8e-aba55287be7c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:08.214097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007950d-8405-4736-9c8e-aba55287be7c None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:08.214889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007950d-8405-4736-9c8e-aba55287be7c None admin] RBAC: Adding query filter params (name=network) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:08.215194 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007950d-8405-4736-9c8e-aba55287be7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:08.216687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007950d-8405-4736-9c8e-aba55287be7c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:08.218082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b836d8-02d6-45fc-a637-868f23b6094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:08.218873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b836d8-02d6-45fc-a637-868f23b6094e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:08.219158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b836d8-02d6-45fc-a637-868f23b6094e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:08.219438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b836d8-02d6-45fc-a637-868f23b6094e None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:08.220234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b836d8-02d6-45fc-a637-868f23b6094e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:08.220582 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b836d8-02d6-45fc-a637-868f23b6094e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:08.221661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 416/823] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:08.222574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007950d-8405-4736-9c8e-aba55287be7c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:08.224829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b836d8-02d6-45fc-a637-868f23b6094e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:08.238364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 408/824] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:08.239301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b836d8-02d6-45fc-a637-868f23b6094e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:08.261379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:08.351694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007950d-8405-4736-9c8e-aba55287be7c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:08.367529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b836d8-02d6-45fc-a637-868f23b6094e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:08.379023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:08.390754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c062a-611a-48cc-b0a3-bd7b09d04051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:08.391618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c062a-611a-48cc-b0a3-bd7b09d04051 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:08.391906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c062a-611a-48cc-b0a3-bd7b09d04051 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:08.392241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c062a-611a-48cc-b0a3-bd7b09d04051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:08.403738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c062a-611a-48cc-b0a3-bd7b09d04051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:08.405471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c062a-611a-48cc-b0a3-bd7b09d04051 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:08.411054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07dbd3-f484-44e5-a468-c50a36990813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:08.411771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07dbd3-f484-44e5-a468-c50a36990813 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:08.412095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07dbd3-f484-44e5-a468-c50a36990813 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:08.412441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07dbd3-f484-44e5-a468-c50a36990813 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:08.414365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07dbd3-f484-44e5-a468-c50a36990813 None admin] RBAC: Adding query filter params (type=network) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:08.414683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07dbd3-f484-44e5-a468-c50a36990813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:08.416763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07dbd3-f484-44e5-a468-c50a36990813 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:08.422362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 409/825] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:08.423136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07dbd3-f484-44e5-a468-c50a36990813 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-023c062a-611a-48cc-b0a3-bd7b09d04051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:08.429788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:08.430821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:08.431928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:08.431928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:08.431928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:08.431928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:08.434113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 417/826] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:08.434959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c062a-611a-48cc-b0a3-bd7b09d04051 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:08.543383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:08.543687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c062a-611a-48cc-b0a3-bd7b09d04051 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:08.570327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07dbd3-f484-44e5-a468-c50a36990813 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:08.581247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590c0d7-fd72-4867-9f0b-1cd7b753e166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:08.582057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590c0d7-fd72-4867-9f0b-1cd7b753e166 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:08.582439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590c0d7-fd72-4867-9f0b-1cd7b753e166 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:08.582814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590c0d7-fd72-4867-9f0b-1cd7b753e166 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:08.583759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590c0d7-fd72-4867-9f0b-1cd7b753e166 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:08.585370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590c0d7-fd72-4867-9f0b-1cd7b753e166 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:08.612197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990e8f6-5b83-4e92-bd76-7eae9f7c4fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:08.613516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990e8f6-5b83-4e92-bd76-7eae9f7c4fe9 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:08.613949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990e8f6-5b83-4e92-bd76-7eae9f7c4fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:08.614370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990e8f6-5b83-4e92-bd76-7eae9f7c4fe9 None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/c3df8c2dd7194952abaa8658bbacd56f/roles/515757e98f5646209fb1eb39aa40ead4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:08.631196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990e8f6-5b83-4e92-bd76-7eae9f7c4fe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=c3df8c2dd7194952abaa8658bbacd56f, role_id=515757e98f5646209fb1eb39aa40ead4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:08.632622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990e8f6-5b83-4e92-bd76-7eae9f7c4fe9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:08.648355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 418/827] 10.222.0.15 () {60 vars in 1144 bytes} [Thu May 26 03:05:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:08.649762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590c0d7-fd72-4867-9f0b-1cd7b753e166 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:08.693461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:08.718346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 410/828] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:05:08 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/c3df8c2dd7194952abaa8658bbacd56f/roles/515757e98f5646209fb1eb39aa40ead4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:05:08.797362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590c0d7-fd72-4867-9f0b-1cd7b753e166 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:08.853169 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93b98-a694-4292-80a3-91fc255a76a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:08.853880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93b98-a694-4292-80a3-91fc255a76a4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:08.854705 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93b98-a694-4292-80a3-91fc255a76a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:08.854984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93b98-a694-4292-80a3-91fc255a76a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:08.855752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93b98-a694-4292-80a3-91fc255a76a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:08.856061 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93b98-a694-4292-80a3-91fc255a76a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:08.857602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93b98-a694-4292-80a3-91fc255a76a4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:08.872649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 419/829] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:08.877900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990e8f6-5b83-4e92-bd76-7eae9f7c4fe9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:08.996503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990e8f6-5b83-4e92-bd76-7eae9f7c4fe9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:09.025907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:09.032712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604140b9-1c4d-4a33-8cd5-d260f4a61f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:09.033539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604140b9-1c4d-4a33-8cd5-d260f4a61f0c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:09.033797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604140b9-1c4d-4a33-8cd5-d260f4a61f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:09.034077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604140b9-1c4d-4a33-8cd5-d260f4a61f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:09.041292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604140b9-1c4d-4a33-8cd5-d260f4a61f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:09.043327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604140b9-1c4d-4a33-8cd5-d260f4a61f0c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-604140b9-1c4d-4a33-8cd5-d260f4a61f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:09.057639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:09.058631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:09.059526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:09.059526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:09.059526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:09.059526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:09.059526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:09.059526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:09.059526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:09.059526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:09.059526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 411/830] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:09.064929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93b98-a694-4292-80a3-91fc255a76a4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:09.169161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:09.181872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93b98-a694-4292-80a3-91fc255a76a4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:09.217618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4681b8f-cdf4-49f2-a0e4-9e4e37bea725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:09.218281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4681b8f-cdf4-49f2-a0e4-9e4e37bea725 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:09.218561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4681b8f-cdf4-49f2-a0e4-9e4e37bea725 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:09.218832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4681b8f-cdf4-49f2-a0e4-9e4e37bea725 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:09.219609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4681b8f-cdf4-49f2-a0e4-9e4e37bea725 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:09.219912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4681b8f-cdf4-49f2-a0e4-9e4e37bea725 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:09.221358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4681b8f-cdf4-49f2-a0e4-9e4e37bea725 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:09.237715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 420/831] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:09.243322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604140b9-1c4d-4a33-8cd5-d260f4a61f0c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:09.317568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7272-2459-4258-b984-9866ef34397b None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:09.318191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7272-2459-4258-b984-9866ef34397b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:09.318679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7272-2459-4258-b984-9866ef34397b None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:09.320543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 421/832] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:09.326022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163da06-dcb0-4eae-a032-4c0e62a9f14a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:09.326316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163da06-dcb0-4eae-a032-4c0e62a9f14a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:09.326599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163da06-dcb0-4eae-a032-4c0e62a9f14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:09.345018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1163da06-dcb0-4eae-a032-4c0e62a9f14a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:09.346296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1163da06-dcb0-4eae-a032-4c0e62a9f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:09.352785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604140b9-1c4d-4a33-8cd5-d260f4a61f0c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:09.387548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a94d04-5f96-43cc-9012-c7e65fac0a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:09.388207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a94d04-5f96-43cc-9012-c7e65fac0a01 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:09.388520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a94d04-5f96-43cc-9012-c7e65fac0a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:09.388801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a94d04-5f96-43cc-9012-c7e65fac0a01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:09.389630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a94d04-5f96-43cc-9012-c7e65fac0a01 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=51f966be1d764324b7695e1caf578291) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:09.389943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a94d04-5f96-43cc-9012-c7e65fac0a01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:09.391515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a94d04-5f96-43cc-9012-c7e65fac0a01 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:09.398151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 412/833] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:09 2022] GET /identity/v3/role_assignments?user.id=51f966be1d764324b7695e1caf578291&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:09.423027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 422/834] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:09.446789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a94d04-5f96-43cc-9012-c7e65fac0a01 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:09.513567 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:09.564260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a94d04-5f96-43cc-9012-c7e65fac0a01 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:09.601009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca862-fcfd-44a4-9ecc-bff3bb86e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:09.601729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca862-fcfd-44a4-9ecc-bff3bb86e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:09.602009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca862-fcfd-44a4-9ecc-bff3bb86e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:09.602287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca862-fcfd-44a4-9ecc-bff3bb86e1b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:09.612398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cca862-fcfd-44a4-9ecc-bff3bb86e1b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b2cca862-fcfd-44a4-9ecc-bff3bb86e1b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:09.620132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:09.621119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:09.621974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 413/835] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:09.629112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163da06-dcb0-4eae-a032-4c0e62a9f14a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:09.711693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:09.733044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163da06-dcb0-4eae-a032-4c0e62a9f14a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:09.770251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13282bed-25e2-4fd3-8c7f-3296bf99a96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:09.770922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13282bed-25e2-4fd3-8c7f-3296bf99a96a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:09.771203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13282bed-25e2-4fd3-8c7f-3296bf99a96a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:09.771478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13282bed-25e2-4fd3-8c7f-3296bf99a96a None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:09.772214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13282bed-25e2-4fd3-8c7f-3296bf99a96a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:09.772547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13282bed-25e2-4fd3-8c7f-3296bf99a96a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:09.773971 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13282bed-25e2-4fd3-8c7f-3296bf99a96a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:09.782911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 423/836] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:09.788887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca862-fcfd-44a4-9ecc-bff3bb86e1b5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:09.900494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca862-fcfd-44a4-9ecc-bff3bb86e1b5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:09.915111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:09.935658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1bf83-11ec-4715-9a64-568386ce9a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:09.940433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1bf83-11ec-4715-9a64-568386ce9a5c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:09.940433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1bf83-11ec-4715-9a64-568386ce9a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:09.940433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1bf83-11ec-4715-9a64-568386ce9a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:09.948675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1bf83-11ec-4715-9a64-568386ce9a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:09.950198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1bf83-11ec-4715-9a64-568386ce9a5c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ade1bf83-11ec-4715-9a64-568386ce9a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:09.967710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:09.968682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:09.969592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:09.969592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:09.969592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:09.969592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:09.969592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 414/837] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:09.974754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13282bed-25e2-4fd3-8c7f-3296bf99a96a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:10.080498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13282bed-25e2-4fd3-8c7f-3296bf99a96a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:10.118073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9300294-065f-4f12-85d8-b8dbc292302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:10.118746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9300294-065f-4f12-85d8-b8dbc292302b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:10.119027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9300294-065f-4f12-85d8-b8dbc292302b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:10.119359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9300294-065f-4f12-85d8-b8dbc292302b None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:10.120699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9300294-065f-4f12-85d8-b8dbc292302b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:10.121006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9300294-065f-4f12-85d8-b8dbc292302b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:10.122354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9300294-065f-4f12-85d8-b8dbc292302b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:10.131489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:10.135538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 424/838] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:10.140681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1bf83-11ec-4715-9a64-568386ce9a5c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:10.251079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1bf83-11ec-4715-9a64-568386ce9a5c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:10.290862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead72c58-f2c4-49c7-b9ed-2060582b81d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:10.292886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead72c58-f2c4-49c7-b9ed-2060582b81d0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:10.293382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead72c58-f2c4-49c7-b9ed-2060582b81d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:10.293864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead72c58-f2c4-49c7-b9ed-2060582b81d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:10.302249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead72c58-f2c4-49c7-b9ed-2060582b81d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:10.304164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead72c58-f2c4-49c7-b9ed-2060582b81d0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ead72c58-f2c4-49c7-b9ed-2060582b81d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:10.319343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:10.320347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 03:05:10.321306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:10.323931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 415/839] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:05:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:10.329293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9300294-065f-4f12-85d8-b8dbc292302b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:10.392711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb4de3-2670-427b-bab0-d9ec5de3b460 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:10.393031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb4de3-2670-427b-bab0-d9ec5de3b460 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:10.393266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb4de3-2670-427b-bab0-d9ec5de3b460 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:10.394743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 416/840] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:10.399556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4699c-fa70-46b1-a952-7d5329989d5a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:10.399841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4699c-fa70-46b1-a952-7d5329989d5a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:10.400119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4699c-fa70-46b1-a952-7d5329989d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:10.421994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-02e4699c-fa70-46b1-a952-7d5329989d5a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:10.423165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-02e4699c-fa70-46b1-a952-7d5329989d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:10.445555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9300294-065f-4f12-85d8-b8dbc292302b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:10.446999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:10.484002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14589bc-63c1-49f2-a3cb-1d4a4eaad2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:10.485045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14589bc-63c1-49f2-a3cb-1d4a4eaad2fc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:10.485529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14589bc-63c1-49f2-a3cb-1d4a4eaad2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:10.486026 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14589bc-63c1-49f2-a3cb-1d4a4eaad2fc None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:10.487044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14589bc-63c1-49f2-a3cb-1d4a4eaad2fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:10.487568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14589bc-63c1-49f2-a3cb-1d4a4eaad2fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:10.489223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14589bc-63c1-49f2-a3cb-1d4a4eaad2fc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:10.508045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 417/841] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:10.522694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 425/842] 10.222.0.15 () {56 vars in 1135 bytes} [Thu May 26 03:05:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:10.523833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4699c-fa70-46b1-a952-7d5329989d5a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:10.533263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14589bc-63c1-49f2-a3cb-1d4a4eaad2fc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:10.596174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:10.632633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4699c-fa70-46b1-a952-7d5329989d5a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:10.643226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14589bc-63c1-49f2-a3cb-1d4a4eaad2fc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:10.671201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba63a1-934d-4202-94d9-041e00e4b7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:10.671942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba63a1-934d-4202-94d9-041e00e4b7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:10.672229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba63a1-934d-4202-94d9-041e00e4b7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:10.672624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba63a1-934d-4202-94d9-041e00e4b7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:10.680415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4fb6a-97fe-49d2-b830-386d22578c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:10.681408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4fb6a-97fe-49d2-b830-386d22578c31 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:10.681755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4fb6a-97fe-49d2-b830-386d22578c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:10.682098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4fb6a-97fe-49d2-b830-386d22578c31 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:10.683430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4fb6a-97fe-49d2-b830-386d22578c31 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:10.684990 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4fb6a-97fe-49d2-b830-386d22578c31 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8db4fb6a-97fe-49d2-b830-386d22578c31 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:10.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:10.699517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 03:05:10.701415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:10.703137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:10.706755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 426/843] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:05:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:10.707633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4fb6a-97fe-49d2-b830-386d22578c31 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:10.746142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba63a1-934d-4202-94d9-041e00e4b7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:10.747602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba63a1-934d-4202-94d9-041e00e4b7f7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:10.816596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4fb6a-97fe-49d2-b830-386d22578c31 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:10.841607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:10.853448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 418/844] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:05:10.854762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e5a4d-bfd3-4c81-8ee9-aee7dc4f4859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:10.855431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e5a4d-bfd3-4c81-8ee9-aee7dc4f4859 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:10.855715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e5a4d-bfd3-4c81-8ee9-aee7dc4f4859 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:10.855992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e5a4d-bfd3-4c81-8ee9-aee7dc4f4859 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:10.863634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e5a4d-bfd3-4c81-8ee9-aee7dc4f4859 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:10.863634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e5a4d-bfd3-4c81-8ee9-aee7dc4f4859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:10.863634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e5a4d-bfd3-4c81-8ee9-aee7dc4f4859 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:10.863892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba63a1-934d-4202-94d9-041e00e4b7f7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:10.863990 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 427/845] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:05:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:10.868813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e5a4d-bfd3-4c81-8ee9-aee7dc4f4859 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:10.952983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:10.981846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e5a4d-bfd3-4c81-8ee9-aee7dc4f4859 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:10.993754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba63a1-934d-4202-94d9-041e00e4b7f7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:11.018189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d6320-cb0a-4345-8541-f57e291a3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:11.019232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d6320-cb0a-4345-8541-f57e291a3104 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.019758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d6320-cb0a-4345-8541-f57e291a3104 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.020228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d6320-cb0a-4345-8541-f57e291a3104 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.021147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d6320-cb0a-4345-8541-f57e291a3104 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:11.021670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d6320-cb0a-4345-8541-f57e291a3104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:11.023216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d6320-cb0a-4345-8541-f57e291a3104 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:11.028882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 428/846] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:05:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:11.040881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b802b4-4d8b-441e-a8f4-422733b3afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:11.042196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b802b4-4d8b-441e-a8f4-422733b3afe0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.042708 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b802b4-4d8b-441e-a8f4-422733b3afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.043231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b802b4-4d8b-441e-a8f4-422733b3afe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.056375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b802b4-4d8b-441e-a8f4-422733b3afe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:11.058251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b802b4-4d8b-441e-a8f4-422733b3afe0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e3b802b4-4d8b-441e-a8f4-422733b3afe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:11.078993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:11.079978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:11.080910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:11.080910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:11.080910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:11.080910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:11.083453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 419/847] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:11.089850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d6320-cb0a-4345-8541-f57e291a3104 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:11.149904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:11.207957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d6320-cb0a-4345-8541-f57e291a3104 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:11.245892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14a1ec-bb73-4c68-a7da-84ee9af3e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:11.246926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14a1ec-bb73-4c68-a7da-84ee9af3e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.247426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14a1ec-bb73-4c68-a7da-84ee9af3e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.247903 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14a1ec-bb73-4c68-a7da-84ee9af3e4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.248862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14a1ec-bb73-4c68-a7da-84ee9af3e4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:11.249390 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14a1ec-bb73-4c68-a7da-84ee9af3e4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:11.250961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14a1ec-bb73-4c68-a7da-84ee9af3e4b4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:11.265095 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 429/848] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:11.270694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b802b4-4d8b-441e-a8f4-422733b3afe0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:11.273661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ed6bf-d67a-40c4-b209-e9084a68d019 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.274284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ed6bf-d67a-40c4-b209-e9084a68d019 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.274566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ed6bf-d67a-40c4-b209-e9084a68d019 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.275982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 430/849] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:11.281452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201c20-cbf8-4cee-8ca3-cb0cce86f101 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.281734 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201c20-cbf8-4cee-8ca3-cb0cce86f101 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.282007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201c20-cbf8-4cee-8ca3-cb0cce86f101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.300110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c8201c20-cbf8-4cee-8ca3-cb0cce86f101 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:11.301671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c8201c20-cbf8-4cee-8ca3-cb0cce86f101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:11.388412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 431/850] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:11.402682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b802b4-4d8b-441e-a8f4-422733b3afe0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:11.407791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8201c20-cbf8-4cee-8ca3-cb0cce86f101 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:11.414170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:11.441447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f24a66-c0ef-46cc-8a67-23786b39cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:11.442768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f24a66-c0ef-46cc-8a67-23786b39cb01 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.443263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f24a66-c0ef-46cc-8a67-23786b39cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.443769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f24a66-c0ef-46cc-8a67-23786b39cb01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.452647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f24a66-c0ef-46cc-8a67-23786b39cb01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:11.454448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f24a66-c0ef-46cc-8a67-23786b39cb01 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:11.458059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-69f24a66-c0ef-46cc-8a67-23786b39cb01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:11.470560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:11.476933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:11.477833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:11.477833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:11.477833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:11.477833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:11.477833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:11.477833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:11.477833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:11.477833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:11.477833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 420/851] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:11.480266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f24a66-c0ef-46cc-8a67-23786b39cb01 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:11.532152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8201c20-cbf8-4cee-8ca3-cb0cce86f101 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:11.576487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309906c0-5940-44de-89a2-3ee2aa8dbed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:11.577324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309906c0-5940-44de-89a2-3ee2aa8dbed9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.577606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309906c0-5940-44de-89a2-3ee2aa8dbed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.577879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309906c0-5940-44de-89a2-3ee2aa8dbed9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.595033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309906c0-5940-44de-89a2-3ee2aa8dbed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-309906c0-5940-44de-89a2-3ee2aa8dbed9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:11.605698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:11.606736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:05:11.607590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:11.611001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 432/852] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:05:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:11.616796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309906c0-5940-44de-89a2-3ee2aa8dbed9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:11.626042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f24a66-c0ef-46cc-8a67-23786b39cb01 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:11.670658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314c7ce-d19b-4967-a52a-10d72042c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:11.671276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314c7ce-d19b-4967-a52a-10d72042c5ca None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.671568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314c7ce-d19b-4967-a52a-10d72042c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.671850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314c7ce-d19b-4967-a52a-10d72042c5ca None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.672693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314c7ce-d19b-4967-a52a-10d72042c5ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:11.673012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314c7ce-d19b-4967-a52a-10d72042c5ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:11.674982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314c7ce-d19b-4967-a52a-10d72042c5ca None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:11.695968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 421/853] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:11.697370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314c7ce-d19b-4967-a52a-10d72042c5ca None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:11.727823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:11.737500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:11.741043 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309906c0-5940-44de-89a2-3ee2aa8dbed9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:11.780059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac44fd-cf4a-4721-9b7c-d8940abaae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:11.780904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac44fd-cf4a-4721-9b7c-d8940abaae4c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.781192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac44fd-cf4a-4721-9b7c-d8940abaae4c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.781469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac44fd-cf4a-4721-9b7c-d8940abaae4c None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.782211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac44fd-cf4a-4721-9b7c-d8940abaae4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:11.782628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac44fd-cf4a-4721-9b7c-d8940abaae4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:11.786607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac44fd-cf4a-4721-9b7c-d8940abaae4c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:11.800344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 433/854] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:05:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:11.800344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49363-59f5-4959-aeb8-ae5d76476aa2 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.800344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49363-59f5-4959-aeb8-ae5d76476aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.800344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49363-59f5-4959-aeb8-ae5d76476aa2 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.800344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 434/855] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:11.806471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa49363-59f5-4959-aeb8-ae5d76476aa2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:11.810857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314c7ce-d19b-4967-a52a-10d72042c5ca None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:11.848019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d61e67-9fb2-45fb-b289-1f5843000e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:11.848730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d61e67-9fb2-45fb-b289-1f5843000e74 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.849015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d61e67-9fb2-45fb-b289-1f5843000e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.849293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d61e67-9fb2-45fb-b289-1f5843000e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.850127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d61e67-9fb2-45fb-b289-1f5843000e74 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=80bd57e333be4921b6270b54a1fac2ef) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:11.850445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d61e67-9fb2-45fb-b289-1f5843000e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:11.851998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d61e67-9fb2-45fb-b289-1f5843000e74 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:11.858826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 422/856] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:11 2022] GET /identity/v3/role_assignments?user.id=80bd57e333be4921b6270b54a1fac2ef&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:11.860362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053cf8f-6d7f-4800-bd32-24911fc50359 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.860863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053cf8f-6d7f-4800-bd32-24911fc50359 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.861342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053cf8f-6d7f-4800-bd32-24911fc50359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:11.879966 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9053cf8f-6d7f-4800-bd32-24911fc50359 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:11.881734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9053cf8f-6d7f-4800-bd32-24911fc50359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:11.946638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa49363-59f5-4959-aeb8-ae5d76476aa2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:11.968754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 423/857] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:11.986920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053cf8f-6d7f-4800-bd32-24911fc50359 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:11.989469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b49fca-2614-4759-b068-3ec756de60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:11.990481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b49fca-2614-4759-b068-3ec756de60a0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:11.990779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b49fca-2614-4759-b068-3ec756de60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:11.991058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b49fca-2614-4759-b068-3ec756de60a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:12.006535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b49fca-2614-4759-b068-3ec756de60a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:12.008050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b49fca-2614-4759-b068-3ec756de60a0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:12.015525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f9b49fca-2614-4759-b068-3ec756de60a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:12.037034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:12.038023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:12.038948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:12.038948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:12.038948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:12.038948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:12.041358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 435/858] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:12.048374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b49fca-2614-4759-b068-3ec756de60a0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:12.071583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:12.119686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053cf8f-6d7f-4800-bd32-24911fc50359 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:12.172492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d2825-f53c-4fc2-b24a-9d91da5081c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:12.173177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b49fca-2614-4759-b068-3ec756de60a0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:12.173912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d2825-f53c-4fc2-b24a-9d91da5081c3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:12.174397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d2825-f53c-4fc2-b24a-9d91da5081c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:12.175138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d2825-f53c-4fc2-b24a-9d91da5081c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:12.176928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d2825-f53c-4fc2-b24a-9d91da5081c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:12.178574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d2825-f53c-4fc2-b24a-9d91da5081c3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f42d2825-f53c-4fc2-b24a-9d91da5081c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:12.194643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:12.195642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 03:05:12.196550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:12.199850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 424/859] 10.222.0.15 () {56 vars in 1132 bytes} [Thu May 26 03:05:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:12.206982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d2825-f53c-4fc2-b24a-9d91da5081c3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:12.217930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06391b3-e086-42f3-9e03-5d97e7bd9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:12.218617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06391b3-e086-42f3-9e03-5d97e7bd9644 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:12.218909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06391b3-e086-42f3-9e03-5d97e7bd9644 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:12.219186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06391b3-e086-42f3-9e03-5d97e7bd9644 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:12.219920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06391b3-e086-42f3-9e03-5d97e7bd9644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:12.220230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06391b3-e086-42f3-9e03-5d97e7bd9644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:12.221762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06391b3-e086-42f3-9e03-5d97e7bd9644 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:12.234507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 436/860] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:12.239903 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06391b3-e086-42f3-9e03-5d97e7bd9644 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:12.308230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:12.317593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:12.327188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d2825-f53c-4fc2-b24a-9d91da5081c3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:12.343984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06391b3-e086-42f3-9e03-5d97e7bd9644 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:12.365250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee0d17-f42c-44c2-a129-f3d274a105ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:12.366276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee0d17-f42c-44c2-a129-f3d274a105ce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:12.366775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee0d17-f42c-44c2-a129-f3d274a105ce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:12.367254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee0d17-f42c-44c2-a129-f3d274a105ce None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:12.368180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee0d17-f42c-44c2-a129-f3d274a105ce None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:12.368712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee0d17-f42c-44c2-a129-f3d274a105ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:12.370324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee0d17-f42c-44c2-a129-f3d274a105ce None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:12.376184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 425/861] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:12.381300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee0d17-f42c-44c2-a129-f3d274a105ce None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:12.382839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f8051-0886-48f1-b59d-9f55a857310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:12.384233 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8051-0886-48f1-b59d-9f55a857310b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:12.384731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8051-0886-48f1-b59d-9f55a857310b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:12.386638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8051-0886-48f1-b59d-9f55a857310b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:12.396745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f8051-0886-48f1-b59d-9f55a857310b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:12.398666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f8051-0886-48f1-b59d-9f55a857310b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-868f8051-0886-48f1-b59d-9f55a857310b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:12.420167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:12.421374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:12.422556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:12.424931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 437/862] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:05:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:12.429975 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f8051-0886-48f1-b59d-9f55a857310b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:12.509819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee0d17-f42c-44c2-a129-f3d274a105ce None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:12.542502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f8051-0886-48f1-b59d-9f55a857310b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:12.553680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ee7c-ad3e-4fce-b03b-b45fca338cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:12.554459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ee7c-ad3e-4fce-b03b-b45fca338cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:12.554848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ee7c-ad3e-4fce-b03b-b45fca338cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:12.555406 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ee7c-ad3e-4fce-b03b-b45fca338cc9 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:12.556139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4ee7c-ad3e-4fce-b03b-b45fca338cc9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:12.556596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4ee7c-ad3e-4fce-b03b-b45fca338cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:12.558119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4ee7c-ad3e-4fce-b03b-b45fca338cc9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:12.568828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 426/863] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:12.584603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d831b0-dc9e-4d06-9276-4db2472af946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:12.585559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d831b0-dc9e-4d06-9276-4db2472af946 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:12.585992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d831b0-dc9e-4d06-9276-4db2472af946 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:12.586672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d831b0-dc9e-4d06-9276-4db2472af946 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:12.587674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d831b0-dc9e-4d06-9276-4db2472af946 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:12.588175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d831b0-dc9e-4d06-9276-4db2472af946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:12.590420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d831b0-dc9e-4d06-9276-4db2472af946 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:12.592581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:12.612860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 438/864] 10.222.0.15 () {56 vars in 1149 bytes} [Thu May 26 03:05:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:12.618527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ee7c-ad3e-4fce-b03b-b45fca338cc9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:12.637509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:12.737416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ee7c-ad3e-4fce-b03b-b45fca338cc9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:12.779995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f005c4-846d-4d76-a91b-ab099f0e5f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:12.780604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f005c4-846d-4d76-a91b-ab099f0e5f4c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:12.780889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f005c4-846d-4d76-a91b-ab099f0e5f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:12.781168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f005c4-846d-4d76-a91b-ab099f0e5f4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:12.856336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f005c4-846d-4d76-a91b-ab099f0e5f4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:12.857856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f005c4-846d-4d76-a91b-ab099f0e5f4c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:12.873599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:12.960070 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 427/865] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:05:12.965904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d831b0-dc9e-4d06-9276-4db2472af946 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:13.074515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d831b0-dc9e-4d06-9276-4db2472af946 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:13.115981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00987f-fe2f-4232-a839-bde2ba3b27c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:13.116840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00987f-fe2f-4232-a839-bde2ba3b27c3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:13.120338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00987f-fe2f-4232-a839-bde2ba3b27c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:13.120338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00987f-fe2f-4232-a839-bde2ba3b27c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:13.130413 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00987f-fe2f-4232-a839-bde2ba3b27c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:13.131980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00987f-fe2f-4232-a839-bde2ba3b27c3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5f00987f-fe2f-4232-a839-bde2ba3b27c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:13.152065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:13.153089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:13.153985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:13.153985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:13.153985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:13.153985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:13.153985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 439/866] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:13.160689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f005c4-846d-4d76-a91b-ab099f0e5f4c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:13.268129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f005c4-846d-4d76-a91b-ab099f0e5f4c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:13.282868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:13.304191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375867d9-f76c-4096-818d-6a42eed1b2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:13.305316 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375867d9-f76c-4096-818d-6a42eed1b2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:13.305807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375867d9-f76c-4096-818d-6a42eed1b2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:13.306288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375867d9-f76c-4096-818d-6a42eed1b2c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:13.307786 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375867d9-f76c-4096-818d-6a42eed1b2c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:13.308299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375867d9-f76c-4096-818d-6a42eed1b2c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:13.310333 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375867d9-f76c-4096-818d-6a42eed1b2c5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:13.316412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565cfc8-ef35-4b88-8982-73271a037bfe None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:13.316702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565cfc8-ef35-4b88-8982-73271a037bfe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:13.316980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565cfc8-ef35-4b88-8982-73271a037bfe None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:13.318605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 440/867] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:13.323631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3943df5-053e-481e-a96f-c216e6ff28b6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:13.323979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3943df5-053e-481e-a96f-c216e6ff28b6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:13.324137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 428/868] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:13.324241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3943df5-053e-481e-a96f-c216e6ff28b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:13.330702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375867d9-f76c-4096-818d-6a42eed1b2c5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:13.345139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d3943df5-053e-481e-a96f-c216e6ff28b6 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:13.347425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d3943df5-053e-481e-a96f-c216e6ff28b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:13.405336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:13.429451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 441/869] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:13.439553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375867d9-f76c-4096-818d-6a42eed1b2c5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:13.451472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3943df5-053e-481e-a96f-c216e6ff28b6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:13.480061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b9453-bc02-4294-8f06-bbd3723c432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:13.481181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9453-bc02-4294-8f06-bbd3723c432b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:13.481783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9453-bc02-4294-8f06-bbd3723c432b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:13.482254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9453-bc02-4294-8f06-bbd3723c432b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:13.489870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b9453-bc02-4294-8f06-bbd3723c432b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:13.491630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b9453-bc02-4294-8f06-bbd3723c432b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-346b9453-bc02-4294-8f06-bbd3723c432b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:13.506102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:13.506999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:13.507898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:13.507898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:13.507898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:13.507898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:13.507898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:13.507898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:13.507898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:13.507898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:13.510495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 429/870] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:13.520360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b9453-bc02-4294-8f06-bbd3723c432b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:13.553297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:13.577785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3943df5-053e-481e-a96f-c216e6ff28b6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:13.615571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbb634-da82-40f5-8997-15043ff2022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:13.616550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbb634-da82-40f5-8997-15043ff2022e None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:13.617021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbb634-da82-40f5-8997-15043ff2022e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:13.617481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbb634-da82-40f5-8997-15043ff2022e None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:13.618390 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbb634-da82-40f5-8997-15043ff2022e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:13.620103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbb634-da82-40f5-8997-15043ff2022e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:13.634201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b9453-bc02-4294-8f06-bbd3723c432b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:13.670621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee303f-04d2-4ba1-83a9-20c0bad3a584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:13.671285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee303f-04d2-4ba1-83a9-20c0bad3a584 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:13.671618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee303f-04d2-4ba1-83a9-20c0bad3a584 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:13.671898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee303f-04d2-4ba1-83a9-20c0bad3a584 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:13.672761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee303f-04d2-4ba1-83a9-20c0bad3a584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:13.673072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee303f-04d2-4ba1-83a9-20c0bad3a584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:13.674671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee303f-04d2-4ba1-83a9-20c0bad3a584 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:13.687094 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 430/871] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:13.692627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee303f-04d2-4ba1-83a9-20c0bad3a584 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:13.701483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 442/872] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:05:13 2022] POST /identity/v3/services => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:05:13.810857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:13.818505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee303f-04d2-4ba1-83a9-20c0bad3a584 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:13.865077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c485cc-8523-46e2-93bf-17c76d7077c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:13.865831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c485cc-8523-46e2-93bf-17c76d7077c6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:13.866059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c485cc-8523-46e2-93bf-17c76d7077c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:13.866337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c485cc-8523-46e2-93bf-17c76d7077c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:13.867193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c485cc-8523-46e2-93bf-17c76d7077c6 None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=c3df8c2dd7194952abaa8658bbacd56f) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:13.867507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c485cc-8523-46e2-93bf-17c76d7077c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:13.869106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c485cc-8523-46e2-93bf-17c76d7077c6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:13.876485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 431/873] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:13 2022] GET /identity/v3/role_assignments?user.id=c3df8c2dd7194952abaa8658bbacd56f&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:14.244992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267901-51f7-400d-b883-618d59be2826 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:14.245983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267901-51f7-400d-b883-618d59be2826 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:14.246513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267901-51f7-400d-b883-618d59be2826 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:14.248363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 443/874] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:14.253859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1dd89-7f92-4b14-9350-100db1b127e7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:14.254383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1dd89-7f92-4b14-9350-100db1b127e7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:14.254869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1dd89-7f92-4b14-9350-100db1b127e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:14.271868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d7e1dd89-7f92-4b14-9350-100db1b127e7 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:14.273424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d7e1dd89-7f92-4b14-9350-100db1b127e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:14.343103 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 432/875] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:14.366422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267901-51f7-400d-b883-618d59be2826 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:14.405120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:14.476483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267901-51f7-400d-b883-618d59be2826 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:14.513838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcb2a3-88c9-4ba7-910c-b910b58c7350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:14.515029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcb2a3-88c9-4ba7-910c-b910b58c7350 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:14.515520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcb2a3-88c9-4ba7-910c-b910b58c7350 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:14.515998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcb2a3-88c9-4ba7-910c-b910b58c7350 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:14.516899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcb2a3-88c9-4ba7-910c-b910b58c7350 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:14.518493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcb2a3-88c9-4ba7-910c-b910b58c7350 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-2cbcb2a3-88c9-4ba7-910c-b910b58c7350 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:14.531433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:14.532482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:14.533319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:14.536132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 444/876] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:14.543202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1dd89-7f92-4b14-9350-100db1b127e7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:14.627572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:14.644730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1dd89-7f92-4b14-9350-100db1b127e7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:14.683425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19af914-1f6f-4450-af83-ee68f16c8c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:14.684121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af914-1f6f-4450-af83-ee68f16c8c0f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:14.684783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af914-1f6f-4450-af83-ee68f16c8c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:14.685413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19af914-1f6f-4450-af83-ee68f16c8c0f None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:14.686199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19af914-1f6f-4450-af83-ee68f16c8c0f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:14.687088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19af914-1f6f-4450-af83-ee68f16c8c0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:14.688550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19af914-1f6f-4450-af83-ee68f16c8c0f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:14.694230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 433/877] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:14.699581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcb2a3-88c9-4ba7-910c-b910b58c7350 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:14.809063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcb2a3-88c9-4ba7-910c-b910b58c7350 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:14.810819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:14.846763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec19c0d-49d9-4528-b1fd-6d5293a7766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:14.847443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec19c0d-49d9-4528-b1fd-6d5293a7766a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:14.847732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec19c0d-49d9-4528-b1fd-6d5293a7766a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:14.848007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec19c0d-49d9-4528-b1fd-6d5293a7766a None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:14.848757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec19c0d-49d9-4528-b1fd-6d5293a7766a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:14.849069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec19c0d-49d9-4528-b1fd-6d5293a7766a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:14.850439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec19c0d-49d9-4528-b1fd-6d5293a7766a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:14.856339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 445/878] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:14.879607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4e0b-9764-4a0c-8076-09d6f632d078 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:14.880246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4e0b-9764-4a0c-8076-09d6f632d078 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:14.880789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4e0b-9764-4a0c-8076-09d6f632d078 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:14.882747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 434/879] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:14.888914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96903c-24ae-402a-9c0c-a31d4033e985 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:14.889217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96903c-24ae-402a-9c0c-a31d4033e985 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:14.889487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96903c-24ae-402a-9c0c-a31d4033e985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:14.908836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ea96903c-24ae-402a-9c0c-a31d4033e985 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:14.910050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ea96903c-24ae-402a-9c0c-a31d4033e985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:14.987553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 446/880] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:15.010218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc4e0b-9764-4a0c-8076-09d6f632d078 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:15.117945 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc4e0b-9764-4a0c-8076-09d6f632d078 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:15.159372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b34fcb-bdd3-4cf6-b2ff-adab4d866e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:15.160090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34fcb-bdd3-4cf6-b2ff-adab4d866e46 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:15.160408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34fcb-bdd3-4cf6-b2ff-adab4d866e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:15.160687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b34fcb-bdd3-4cf6-b2ff-adab4d866e46 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:15.161471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b34fcb-bdd3-4cf6-b2ff-adab4d866e46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:15.162841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b34fcb-bdd3-4cf6-b2ff-adab4d866e46 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:15.266736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 435/881] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:05:15 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:15.970107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21014f2-2aed-4360-b8b4-6bfc603e626d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:15.971165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21014f2-2aed-4360-b8b4-6bfc603e626d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:15.971597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21014f2-2aed-4360-b8b4-6bfc603e626d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:15.973371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 447/882] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:15.979677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ead03-994b-4c2d-a743-bb1ad7bb08fb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:15.980542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ead03-994b-4c2d-a743-bb1ad7bb08fb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:15.980982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ead03-994b-4c2d-a743-bb1ad7bb08fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:15.999643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9a0ead03-994b-4c2d-a743-bb1ad7bb08fb None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:16.001193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9a0ead03-994b-4c2d-a743-bb1ad7bb08fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:16.003522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:16.084469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 436/883] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:16.107475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21014f2-2aed-4360-b8b4-6bfc603e626d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:16.201595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:16.211266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21014f2-2aed-4360-b8b4-6bfc603e626d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:16.241026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848ce9c-c651-4c3f-8ba0-6fa96bfbf28a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.241642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848ce9c-c651-4c3f-8ba0-6fa96bfbf28a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.242135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848ce9c-c651-4c3f-8ba0-6fa96bfbf28a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.244301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 437/884] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:16.249341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfe995-b858-49a8-97c6-a20349d106fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:16.250163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831babc1-578c-4539-856b-96650a26da2d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.250487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfe995-b858-49a8-97c6-a20349d106fc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.250835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfe995-b858-49a8-97c6-a20349d106fc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.251088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831babc1-578c-4539-856b-96650a26da2d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.251374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfe995-b858-49a8-97c6-a20349d106fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.251777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831babc1-578c-4539-856b-96650a26da2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.252398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfe995-b858-49a8-97c6-a20349d106fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:16.253764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfe995-b858-49a8-97c6-a20349d106fc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ccdfe995-b858-49a8-97c6-a20349d106fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:16.267618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:16.268775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:16.269689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 448/885] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:05:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:16.273315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-831babc1-578c-4539-856b-96650a26da2d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:16.274756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfe995-b858-49a8-97c6-a20349d106fc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:16.275408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-831babc1-578c-4539-856b-96650a26da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:16.356716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 438/886] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:16.380996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831babc1-578c-4539-856b-96650a26da2d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:16.393315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfe995-b858-49a8-97c6-a20349d106fc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:16.438081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e57524-65b3-4f65-aa78-a4953d536cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:16.438761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e57524-65b3-4f65-aa78-a4953d536cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.439041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e57524-65b3-4f65-aa78-a4953d536cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.439319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e57524-65b3-4f65-aa78-a4953d536cd2 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.440348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e57524-65b3-4f65-aa78-a4953d536cd2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:16.440663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e57524-65b3-4f65-aa78-a4953d536cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:16.442282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e57524-65b3-4f65-aa78-a4953d536cd2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:16.452393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 449/887] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:05:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:16.454017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e57524-65b3-4f65-aa78-a4953d536cd2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:16.464702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:16.487214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:16.511856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831babc1-578c-4539-856b-96650a26da2d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:16.550631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebf187-b242-43c7-8b6d-6200ade1b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:16.551904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebf187-b242-43c7-8b6d-6200ade1b70e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.552465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebf187-b242-43c7-8b6d-6200ade1b70e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.552964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebf187-b242-43c7-8b6d-6200ade1b70e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.564182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebf187-b242-43c7-8b6d-6200ade1b70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-dcebf187-b242-43c7-8b6d-6200ade1b70e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:16.573003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:16.573968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:16.574842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:16.582209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 439/888] 10.222.0.15 () {56 vars in 1120 bytes} [Thu May 26 03:05:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:16.582906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e57524-65b3-4f65-aa78-a4953d536cd2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:16.583562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebf187-b242-43c7-8b6d-6200ade1b70e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:16.622747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c18879-0333-4995-b608-ad4d266e13f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:16.623918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c18879-0333-4995-b608-ad4d266e13f5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.624726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c18879-0333-4995-b608-ad4d266e13f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.625474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c18879-0333-4995-b608-ad4d266e13f5 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.626379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c18879-0333-4995-b608-ad4d266e13f5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:16.626962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c18879-0333-4995-b608-ad4d266e13f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:16.629661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c18879-0333-4995-b608-ad4d266e13f5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:16.635995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 450/889] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:05:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:16.641719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c18879-0333-4995-b608-ad4d266e13f5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:16.702677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebf187-b242-43c7-8b6d-6200ade1b70e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:16.727689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:16.736866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:16.739586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce84ff-cfce-430a-b31e-855744800d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:16.740259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce84ff-cfce-430a-b31e-855744800d67 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.745256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce84ff-cfce-430a-b31e-855744800d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.745256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce84ff-cfce-430a-b31e-855744800d67 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.745256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce84ff-cfce-430a-b31e-855744800d67 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:16.745256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce84ff-cfce-430a-b31e-855744800d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:16.745256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce84ff-cfce-430a-b31e-855744800d67 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:16.754010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c18879-0333-4995-b608-ad4d266e13f5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:16.755159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 440/890] 10.222.0.15 () {56 vars in 1115 bytes} [Thu May 26 03:05:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:16.761390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce84ff-cfce-430a-b31e-855744800d67 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:16.798396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc8efa-6aa1-45a2-8097-afd0a7a04f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:16.799114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc8efa-6aa1-45a2-8097-afd0a7a04f37 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.799403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc8efa-6aa1-45a2-8097-afd0a7a04f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.799681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc8efa-6aa1-45a2-8097-afd0a7a04f37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.800541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc8efa-6aa1-45a2-8097-afd0a7a04f37 None admin] RBAC: Adding query filter params (interface=public, service_id=35d017f8e5944cd6a6c581f513d46957, region_id=RegionOne) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:16.804193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc8efa-6aa1-45a2-8097-afd0a7a04f37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:16.807222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc8efa-6aa1-45a2-8097-afd0a7a04f37 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:16.817029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 451/891] 10.222.0.15 () {56 vars in 1251 bytes} [Thu May 26 03:05:16 2022] GET /identity/v3/endpoints?service_id=35d017f8e5944cd6a6c581f513d46957&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:16.821819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc8efa-6aa1-45a2-8097-afd0a7a04f37 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:16.883081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce84ff-cfce-430a-b31e-855744800d67 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:16.920197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032535dd-f674-4fd0-a60f-f1991ec1d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:16.921510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032535dd-f674-4fd0-a60f-f1991ec1d190 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.922000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032535dd-f674-4fd0-a60f-f1991ec1d190 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.922487 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032535dd-f674-4fd0-a60f-f1991ec1d190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.933558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032535dd-f674-4fd0-a60f-f1991ec1d190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:16.935384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032535dd-f674-4fd0-a60f-f1991ec1d190 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:16.950354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc8efa-6aa1-45a2-8097-afd0a7a04f37 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-032535dd-f674-4fd0-a60f-f1991ec1d190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:16.956087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:16.957251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:16.958160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:16.958160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:16.958160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:16.958160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:16.964692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 441/892] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:16.967577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032535dd-f674-4fd0-a60f-f1991ec1d190 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:16.990817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39717f59-51b3-43ec-8ead-5fbc078106b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:16.992354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717f59-51b3-43ec-8ead-5fbc078106b6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:16.992871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717f59-51b3-43ec-8ead-5fbc078106b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:16.993360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717f59-51b3-43ec-8ead-5fbc078106b6 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:16.994356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39717f59-51b3-43ec-8ead-5fbc078106b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:16.995988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39717f59-51b3-43ec-8ead-5fbc078106b6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:17.002670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 452/893] 10.222.0.15 () {56 vars in 1087 bytes} [Thu May 26 03:05:16 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:05:17.015403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:17.084590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032535dd-f674-4fd0-a60f-f1991ec1d190 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:17.123707 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddcc5b-8e0a-42cd-ae94-57e977afcda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:17.124418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddcc5b-8e0a-42cd-ae94-57e977afcda3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.124704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddcc5b-8e0a-42cd-ae94-57e977afcda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.124985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddcc5b-8e0a-42cd-ae94-57e977afcda3 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.125720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddcc5b-8e0a-42cd-ae94-57e977afcda3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:17.126028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddcc5b-8e0a-42cd-ae94-57e977afcda3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:17.127424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddcc5b-8e0a-42cd-ae94-57e977afcda3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:17.141321 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 442/894] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:17.146820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7086a8-2637-4d2b-a548-0fde33083c84 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.147108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7086a8-2637-4d2b-a548-0fde33083c84 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.147388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7086a8-2637-4d2b-a548-0fde33083c84 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.149374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddcc5b-8e0a-42cd-ae94-57e977afcda3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:17.152537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 453/895] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:17.155221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718114af-5a75-4de5-bf72-bbb408be3206 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.155699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718114af-5a75-4de5-bf72-bbb408be3206 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.156122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718114af-5a75-4de5-bf72-bbb408be3206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.175808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-718114af-5a75-4de5-bf72-bbb408be3206 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:17.178433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-718114af-5a75-4de5-bf72-bbb408be3206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:17.188773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:17.265469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 454/896] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:17.272749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:17.276860 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddcc5b-8e0a-42cd-ae94-57e977afcda3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:17.295812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718114af-5a75-4de5-bf72-bbb408be3206 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:17.313662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d2b86-43c5-40c4-94d4-2ca35aa61fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:17.314854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d2b86-43c5-40c4-94d4-2ca35aa61fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.315352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d2b86-43c5-40c4-94d4-2ca35aa61fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.315778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d2b86-43c5-40c4-94d4-2ca35aa61fd5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.324488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d2b86-43c5-40c4-94d4-2ca35aa61fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:17.326313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d2b86-43c5-40c4-94d4-2ca35aa61fd5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1f9d2b86-43c5-40c4-94d4-2ca35aa61fd5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:17.343192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:17.344243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:17.345267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:17.348241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 443/897] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:05:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:17.354182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d2b86-43c5-40c4-94d4-2ca35aa61fd5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:17.422893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718114af-5a75-4de5-bf72-bbb408be3206 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:17.462066 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c6cbe-fe6f-45c5-bde8-74fc4b00e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:17.463132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6cbe-fe6f-45c5-bde8-74fc4b00e6f0 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.463615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6cbe-fe6f-45c5-bde8-74fc4b00e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.464197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6cbe-fe6f-45c5-bde8-74fc4b00e6f0 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.465233 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c6cbe-fe6f-45c5-bde8-74fc4b00e6f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:17.466811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c6cbe-fe6f-45c5-bde8-74fc4b00e6f0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:17.473746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d2b86-43c5-40c4-94d4-2ca35aa61fd5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:17.508776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40626217-dc3b-4631-8be3-e55d2f4f8ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:17.509474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40626217-dc3b-4631-8be3-e55d2f4f8ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.509756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40626217-dc3b-4631-8be3-e55d2f4f8ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.510590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40626217-dc3b-4631-8be3-e55d2f4f8ed7 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.511432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40626217-dc3b-4631-8be3-e55d2f4f8ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:17.511745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40626217-dc3b-4631-8be3-e55d2f4f8ed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:17.513211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40626217-dc3b-4631-8be3-e55d2f4f8ed7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:17.531306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 444/898] 10.222.0.15 () {56 vars in 1149 bytes} [Thu May 26 03:05:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:17.532821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f536-784d-4044-8b24-4633def5b48c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.533106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f536-784d-4044-8b24-4633def5b48c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.533385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f536-784d-4044-8b24-4633def5b48c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.537421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 445/899] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:17.537421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0f536-784d-4044-8b24-4633def5b48c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:17.555088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:17.568823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 455/900] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:05:17 2022] POST /identity/v3/services => generated 241 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:17.570957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cb2cd-3fee-4ea2-9d72-035740702f07 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.571255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cb2cd-3fee-4ea2-9d72-035740702f07 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.571536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cb2cd-3fee-4ea2-9d72-035740702f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.578366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:17.594366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5e2cb2cd-3fee-4ea2-9d72-035740702f07 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:17.595987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5e2cb2cd-3fee-4ea2-9d72-035740702f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:17.664910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0f536-784d-4044-8b24-4633def5b48c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:17.677359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 456/901] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:17.700929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cb2cd-3fee-4ea2-9d72-035740702f07 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:17.706251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e530f-494a-46b4-9a29-9fcf75c966a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:17.706926 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e530f-494a-46b4-9a29-9fcf75c966a1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.707264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e530f-494a-46b4-9a29-9fcf75c966a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.707548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e530f-494a-46b4-9a29-9fcf75c966a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.790688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e530f-494a-46b4-9a29-9fcf75c966a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:17.792271 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e530f-494a-46b4-9a29-9fcf75c966a1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:17.808607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:17.838739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cb2cd-3fee-4ea2-9d72-035740702f07 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:17.876385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:17.882074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ddc69-735a-4981-91d5-0ffa892f9a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:17.882894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ddc69-735a-4981-91d5-0ffa892f9a9b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:17.883180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ddc69-735a-4981-91d5-0ffa892f9a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:17.883494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ddc69-735a-4981-91d5-0ffa892f9a9b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:17.884779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ddc69-735a-4981-91d5-0ffa892f9a9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:17.887264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ddc69-735a-4981-91d5-0ffa892f9a9b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-3c6ddc69-735a-4981-91d5-0ffa892f9a9b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:17.905927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:17.906940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 03:05:17.907789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:17.911353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 457/902] 10.222.0.15 () {56 vars in 1132 bytes} [Thu May 26 03:05:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:17.915197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 446/903] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 03:05:17.920145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ddc69-735a-4981-91d5-0ffa892f9a9b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:17.921236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e530f-494a-46b4-9a29-9fcf75c966a1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:18.029197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e530f-494a-46b4-9a29-9fcf75c966a1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:18.030493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ddc69-735a-4981-91d5-0ffa892f9a9b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:18.044534 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:18.076816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6533-20e4-4b39-bc93-16c57147824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:18.077489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6533-20e4-4b39-bc93-16c57147824a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:18.077768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6533-20e4-4b39-bc93-16c57147824a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:18.078042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6533-20e4-4b39-bc93-16c57147824a None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:18.078741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a6533-20e4-4b39-bc93-16c57147824a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:18.079045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a6533-20e4-4b39-bc93-16c57147824a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:18.080444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a6533-20e4-4b39-bc93-16c57147824a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:18.084451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bec31-d725-4a29-8216-b13912dfc8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:18.085499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bec31-d725-4a29-8216-b13912dfc8da None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:18.086254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bec31-d725-4a29-8216-b13912dfc8da None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:18.086922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bec31-d725-4a29-8216-b13912dfc8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:18.090528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 458/904] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:18.091403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6533-20e4-4b39-bc93-16c57147824a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:18.100831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bec31-d725-4a29-8216-b13912dfc8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:18.102915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bec31-d725-4a29-8216-b13912dfc8da None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-de8bec31-d725-4a29-8216-b13912dfc8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:18.127965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:18.128941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:18.129844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:18.129844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:18.129844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:18.129844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:18.132079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 447/905] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:18.137805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bec31-d725-4a29-8216-b13912dfc8da None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:18.165070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:18.221954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6533-20e4-4b39-bc93-16c57147824a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:18.257199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bec31-d725-4a29-8216-b13912dfc8da None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:18.264829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05977e-d745-46f6-81c6-d3c36fcac9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:18.265500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05977e-d745-46f6-81c6-d3c36fcac9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:18.265779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05977e-d745-46f6-81c6-d3c36fcac9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:18.266052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05977e-d745-46f6-81c6-d3c36fcac9f3 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:18.267004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05977e-d745-46f6-81c6-d3c36fcac9f3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:18.267117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05977e-d745-46f6-81c6-d3c36fcac9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:18.268414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05977e-d745-46f6-81c6-d3c36fcac9f3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:18.273900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 459/906] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:18.279078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05977e-d745-46f6-81c6-d3c36fcac9f3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:18.301106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde92c4-242b-47fe-967d-3aa4453ed8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:18.302120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde92c4-242b-47fe-967d-3aa4453ed8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:18.302614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde92c4-242b-47fe-967d-3aa4453ed8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:18.303107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde92c4-242b-47fe-967d-3aa4453ed8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:18.304021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde92c4-242b-47fe-967d-3aa4453ed8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:18.304564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde92c4-242b-47fe-967d-3aa4453ed8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:18.306144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde92c4-242b-47fe-967d-3aa4453ed8f2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:18.324691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 448/907] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:18.326264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde92c4-242b-47fe-967d-3aa4453ed8f2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:18.353413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:18.401671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05977e-d745-46f6-81c6-d3c36fcac9f3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:18.425992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:18.433529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde92c4-242b-47fe-967d-3aa4453ed8f2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:18.438836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d79671-bc06-4eb1-93ea-c8ee832312cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:18.439703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d79671-bc06-4eb1-93ea-c8ee832312cf None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:18.440135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d79671-bc06-4eb1-93ea-c8ee832312cf None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:18.440628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d79671-bc06-4eb1-93ea-c8ee832312cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:18.441553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d79671-bc06-4eb1-93ea-c8ee832312cf None admin] RBAC: Adding query filter params (interface=public, service_id=6cbb6df37ab445c0b371ba86a6bb0f8f, region_id=RegionOne) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:18.442008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d79671-bc06-4eb1-93ea-c8ee832312cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:18.443592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d79671-bc06-4eb1-93ea-c8ee832312cf None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:18.453689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 460/908] 10.222.0.15 () {56 vars in 1251 bytes} [Thu May 26 03:05:18 2022] GET /identity/v3/endpoints?service_id=6cbb6df37ab445c0b371ba86a6bb0f8f&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:18.455187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d79671-bc06-4eb1-93ea-c8ee832312cf None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:18.470626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73af2-b2eb-46a9-b8a9-5ea6cdc20d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:18.471420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73af2-b2eb-46a9-b8a9-5ea6cdc20d98 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:18.471701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73af2-b2eb-46a9-b8a9-5ea6cdc20d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:18.471976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73af2-b2eb-46a9-b8a9-5ea6cdc20d98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:18.479654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73af2-b2eb-46a9-b8a9-5ea6cdc20d98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:18.481214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73af2-b2eb-46a9-b8a9-5ea6cdc20d98 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a7a73af2-b2eb-46a9-b8a9-5ea6cdc20d98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:18.496183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:18.497252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:18.498490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:18.498490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:18.498490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:18.498490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:18.498490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:18.498490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:18.498490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:18.498490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:18.502230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 449/909] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:18.503254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73af2-b2eb-46a9-b8a9-5ea6cdc20d98 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:18.562688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d79671-bc06-4eb1-93ea-c8ee832312cf None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:18.588037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:18.598199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fc248-8b41-4500-a355-4cda9e18f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:18.599035 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fc248-8b41-4500-a355-4cda9e18f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:18.601771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fc248-8b41-4500-a355-4cda9e18f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:18.601771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fc248-8b41-4500-a355-4cda9e18f8b5 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:18.601771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fc248-8b41-4500-a355-4cda9e18f8b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:18.602179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fc248-8b41-4500-a355-4cda9e18f8b5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:18.606449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73af2-b2eb-46a9-b8a9-5ea6cdc20d98 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:18.616816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 461/910] 10.222.0.15 () {56 vars in 1087 bytes} [Thu May 26 03:05:18 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:05:18.645856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee9068-cbc7-4500-80fc-f9fedf6528c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:18.646635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee9068-cbc7-4500-80fc-f9fedf6528c6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:18.647076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee9068-cbc7-4500-80fc-f9fedf6528c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:18.647425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee9068-cbc7-4500-80fc-f9fedf6528c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:18.648373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee9068-cbc7-4500-80fc-f9fedf6528c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:18.648760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee9068-cbc7-4500-80fc-f9fedf6528c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:18.650312 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee9068-cbc7-4500-80fc-f9fedf6528c6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:18.668463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 450/911] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:18.671237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fc248-8b41-4500-a355-4cda9e18f8b5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:18.731017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:18.783724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fc248-8b41-4500-a355-4cda9e18f8b5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:18.839566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f7b5c-028e-43ae-aced-2f9cd112ebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:18.839566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f7b5c-028e-43ae-aced-2f9cd112ebf4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:18.839566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f7b5c-028e-43ae-aced-2f9cd112ebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:18.839566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f7b5c-028e-43ae-aced-2f9cd112ebf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:18.839987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f7b5c-028e-43ae-aced-2f9cd112ebf4 None admin] RBAC: Adding query filter params (role.id=d37e7ae615d44a709c874db9d5fa0d2f, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=c3df8c2dd7194952abaa8658bbacd56f) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:18.839987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f7b5c-028e-43ae-aced-2f9cd112ebf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:18.839987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f7b5c-028e-43ae-aced-2f9cd112ebf4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:18.842296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 462/912] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:18 2022] GET /identity/v3/role_assignments?user.id=c3df8c2dd7194952abaa8658bbacd56f&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=d37e7ae615d44a709c874db9d5fa0d2f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:19.332282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7a4df-c41a-4f7b-a802-0fe923a7174e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:19.332843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7a4df-c41a-4f7b-a802-0fe923a7174e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:19.332843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7a4df-c41a-4f7b-a802-0fe923a7174e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:19.334481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 451/913] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:19.340590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796548a2-bc40-4b8a-ac4e-de3d33abe66a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:19.341009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796548a2-bc40-4b8a-ac4e-de3d33abe66a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:19.341164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796548a2-bc40-4b8a-ac4e-de3d33abe66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:19.358087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-796548a2-bc40-4b8a-ac4e-de3d33abe66a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:19.359268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-796548a2-bc40-4b8a-ac4e-de3d33abe66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:19.428804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 463/914] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:19.452164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7a4df-c41a-4f7b-a802-0fe923a7174e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:19.555056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7a4df-c41a-4f7b-a802-0fe923a7174e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:19.590053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe02830-fe81-4dc4-829e-78ad5beb6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:19.590782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe02830-fe81-4dc4-829e-78ad5beb6657 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:19.591115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe02830-fe81-4dc4-829e-78ad5beb6657 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:19.591394 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe02830-fe81-4dc4-829e-78ad5beb6657 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:19.592045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe02830-fe81-4dc4-829e-78ad5beb6657 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:19.593505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe02830-fe81-4dc4-829e-78ad5beb6657 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5fe02830-fe81-4dc4-829e-78ad5beb6657 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:19.605369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:19.606393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:19.607260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 452/915] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:05:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:19.613394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796548a2-bc40-4b8a-ac4e-de3d33abe66a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:19.661534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:19.720406 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796548a2-bc40-4b8a-ac4e-de3d33abe66a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:19.756185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf33fd-0d1a-407b-9b49-dfd416b72fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:19.756893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf33fd-0d1a-407b-9b49-dfd416b72fbb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:19.757182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf33fd-0d1a-407b-9b49-dfd416b72fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:19.757463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf33fd-0d1a-407b-9b49-dfd416b72fbb None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:19.758165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf33fd-0d1a-407b-9b49-dfd416b72fbb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:19.758476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf33fd-0d1a-407b-9b49-dfd416b72fbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:19.759884 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf33fd-0d1a-407b-9b49-dfd416b72fbb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:19.765572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 464/916] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:05:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:19.771153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe02830-fe81-4dc4-829e-78ad5beb6657 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:19.788654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:19.886322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe02830-fe81-4dc4-829e-78ad5beb6657 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:19.903394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1dc6-feb5-4c7c-bc82-18c0c30098a5 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:19.903712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1dc6-feb5-4c7c-bc82-18c0c30098a5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:19.904000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1dc6-feb5-4c7c-bc82-18c0c30098a5 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:19.905748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 465/917] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:19.910739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383063f-8413-4add-aec8-723430082f0c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:19.911030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383063f-8413-4add-aec8-723430082f0c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:19.911315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383063f-8413-4add-aec8-723430082f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:19.921906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d845-153f-4919-989e-1a4de71b2a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:19.922570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d845-153f-4919-989e-1a4de71b2a18 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:19.922852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d845-153f-4919-989e-1a4de71b2a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:19.923128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d845-153f-4919-989e-1a4de71b2a18 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:19.923830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d845-153f-4919-989e-1a4de71b2a18 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:19.924134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d845-153f-4919-989e-1a4de71b2a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:19.925544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d845-153f-4919-989e-1a4de71b2a18 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:19.928910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6383063f-8413-4add-aec8-723430082f0c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:19.930111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6383063f-8413-4add-aec8-723430082f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:19.930954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 453/918] 10.222.0.15 () {56 vars in 1114 bytes} [Thu May 26 03:05:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:19.937773 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d845-153f-4919-989e-1a4de71b2a18 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:20.008726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 466/919] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:20.012649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:20.027919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383063f-8413-4add-aec8-723430082f0c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:20.042852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d845-153f-4919-989e-1a4de71b2a18 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:20.075301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:20.079434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676dcdc-e105-4b30-a883-ac3402cc819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:20.080099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676dcdc-e105-4b30-a883-ac3402cc819c None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:20.080403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676dcdc-e105-4b30-a883-ac3402cc819c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:20.080697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676dcdc-e105-4b30-a883-ac3402cc819c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:20.081442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676dcdc-e105-4b30-a883-ac3402cc819c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:20.082810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676dcdc-e105-4b30-a883-ac3402cc819c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:20.137980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383063f-8413-4add-aec8-723430082f0c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:20.160440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 454/920] 10.222.0.15 () {60 vars in 1144 bytes} [Thu May 26 03:05:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:20.187119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacda8d-400c-47ac-bd4c-e36b7731ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:20.187958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacda8d-400c-47ac-bd4c-e36b7731ca55 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:20.188244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacda8d-400c-47ac-bd4c-e36b7731ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:20.188574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacda8d-400c-47ac-bd4c-e36b7731ca55 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:20.189242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacda8d-400c-47ac-bd4c-e36b7731ca55 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:20.190716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacda8d-400c-47ac-bd4c-e36b7731ca55 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5bacda8d-400c-47ac-bd4c-e36b7731ca55 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:20.204117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:20.206641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:20.208706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 467/921] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:20.216342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676dcdc-e105-4b30-a883-ac3402cc819c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:20.328446 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676dcdc-e105-4b30-a883-ac3402cc819c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:20.359493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:20.366626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36edddf-1791-4df1-8b4d-06fa31d1ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:20.367298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36edddf-1791-4df1-8b4d-06fa31d1ccea None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:20.367576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36edddf-1791-4df1-8b4d-06fa31d1ccea None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:20.367845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36edddf-1791-4df1-8b4d-06fa31d1ccea None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:20.368586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36edddf-1791-4df1-8b4d-06fa31d1ccea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:20.368900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36edddf-1791-4df1-8b4d-06fa31d1ccea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:20.370319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36edddf-1791-4df1-8b4d-06fa31d1ccea None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:20.375223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 455/922] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:20.381449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacda8d-400c-47ac-bd4c-e36b7731ca55 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:20.488227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:20.491088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacda8d-400c-47ac-bd4c-e36b7731ca55 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:20.525490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4c20-04f9-498d-b9ee-1929a70d697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:20.527139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4c20-04f9-498d-b9ee-1929a70d697e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:20.527769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4c20-04f9-498d-b9ee-1929a70d697e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:20.528248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4c20-04f9-498d-b9ee-1929a70d697e None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:20.528985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4c20-04f9-498d-b9ee-1929a70d697e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:20.529754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4c20-04f9-498d-b9ee-1929a70d697e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:20.531125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4c20-04f9-498d-b9ee-1929a70d697e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:20.536703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 468/923] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:20.542517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36edddf-1791-4df1-8b4d-06fa31d1ccea None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:20.652330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36edddf-1791-4df1-8b4d-06fa31d1ccea None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:20.687830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af814000-ec54-45cd-b78f-a532b38a2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:20.688894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814000-ec54-45cd-b78f-a532b38a2a45 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:20.689383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814000-ec54-45cd-b78f-a532b38a2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:20.689877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814000-ec54-45cd-b78f-a532b38a2a45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:20.690863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af814000-ec54-45cd-b78f-a532b38a2a45 None admin] RBAC: Adding query filter params (interface=public, service_id=cb2c8b24b5b3488a8b817e4909951432, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:20.691392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af814000-ec54-45cd-b78f-a532b38a2a45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:20.693006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af814000-ec54-45cd-b78f-a532b38a2a45 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:20.699403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 456/924] 10.222.0.15 () {56 vars in 1251 bytes} [Thu May 26 03:05:20 2022] GET /identity/v3/endpoints?service_id=cb2c8b24b5b3488a8b817e4909951432&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:20.705331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4c20-04f9-498d-b9ee-1929a70d697e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:20.830585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4c20-04f9-498d-b9ee-1929a70d697e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:20.867301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1a074-ec98-4d8f-a48a-7ce60efb444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:20.868382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1a074-ec98-4d8f-a48a-7ce60efb444f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:20.868875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1a074-ec98-4d8f-a48a-7ce60efb444f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:20.869925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1a074-ec98-4d8f-a48a-7ce60efb444f None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:20.870853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1a074-ec98-4d8f-a48a-7ce60efb444f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:20.872527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1a074-ec98-4d8f-a48a-7ce60efb444f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:20.879225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 469/925] 10.222.0.15 () {56 vars in 1087 bytes} [Thu May 26 03:05:20 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:05:20.922767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336115e5-c982-40ee-9eae-78100bfafb1a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:20.923395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336115e5-c982-40ee-9eae-78100bfafb1a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:20.923912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336115e5-c982-40ee-9eae-78100bfafb1a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:20.925809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 457/926] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:20.931889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824f624-a6b4-4a8f-a1ee-692269883fc2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:20.932550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824f624-a6b4-4a8f-a1ee-692269883fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:20.933041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824f624-a6b4-4a8f-a1ee-692269883fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:20.953084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0824f624-a6b4-4a8f-a1ee-692269883fc2 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:20.954879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0824f624-a6b4-4a8f-a1ee-692269883fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:20.985200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:21.038398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 470/927] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:21.062637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336115e5-c982-40ee-9eae-78100bfafb1a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:21.129665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:21.146047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97858d-57bc-47c1-abfb-74565af23b3e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:21.147265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97858d-57bc-47c1-abfb-74565af23b3e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:21.147265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97858d-57bc-47c1-abfb-74565af23b3e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:21.148226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 471/928] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:21.153828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ffacb-0581-4dbd-81ff-3db27373b230 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:21.154115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ffacb-0581-4dbd-81ff-3db27373b230 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:21.154397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ffacb-0581-4dbd-81ff-3db27373b230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:21.173077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-300ffacb-0581-4dbd-81ff-3db27373b230 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:21.174297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-300ffacb-0581-4dbd-81ff-3db27373b230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:21.176807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336115e5-c982-40ee-9eae-78100bfafb1a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:21.211616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d4dc2-7325-45c1-8f1c-76663baf0ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:21.212469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4dc2-7325-45c1-8f1c-76663baf0ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:21.212757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4dc2-7325-45c1-8f1c-76663baf0ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:21.213578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4dc2-7325-45c1-8f1c-76663baf0ac7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:21.214227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d4dc2-7325-45c1-8f1c-76663baf0ac7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:21.215625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d4dc2-7325-45c1-8f1c-76663baf0ac7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2a4d4dc2-7325-45c1-8f1c-76663baf0ac7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:21.228057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:21.229641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:21.230826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 458/929] 10.222.0.15 () {56 vars in 1132 bytes} [Thu May 26 03:05:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:21.236203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d4dc2-7325-45c1-8f1c-76663baf0ac7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:21.260481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 472/930] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:21.280272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ffacb-0581-4dbd-81ff-3db27373b230 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:21.346492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d4dc2-7325-45c1-8f1c-76663baf0ac7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:21.368658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:21.379501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:21.384415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8155251-1a6b-48ff-b6a9-48312040e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:21.385749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155251-1a6b-48ff-b6a9-48312040e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:21.401368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155251-1a6b-48ff-b6a9-48312040e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:21.401368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155251-1a6b-48ff-b6a9-48312040e3c3 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:21.401368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8155251-1a6b-48ff-b6a9-48312040e3c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:21.401368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8155251-1a6b-48ff-b6a9-48312040e3c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:21.401368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8155251-1a6b-48ff-b6a9-48312040e3c3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:21.401789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ffacb-0581-4dbd-81ff-3db27373b230 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:21.402218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 459/931] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:21.404265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8155251-1a6b-48ff-b6a9-48312040e3c3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:21.443012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35f4f1-b10d-4f46-9696-9f5ea7d60464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:21.444688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35f4f1-b10d-4f46-9696-9f5ea7d60464 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:21.445326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35f4f1-b10d-4f46-9696-9f5ea7d60464 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:21.445813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35f4f1-b10d-4f46-9696-9f5ea7d60464 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:21.461223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35f4f1-b10d-4f46-9696-9f5ea7d60464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ca35f4f1-b10d-4f46-9696-9f5ea7d60464 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:21.469993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:21.470950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:21.471794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:21.476283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 473/932] 10.222.0.15 () {56 vars in 1120 bytes} [Thu May 26 03:05:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:21.477342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35f4f1-b10d-4f46-9696-9f5ea7d60464 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:21.538722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8155251-1a6b-48ff-b6a9-48312040e3c3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:21.582527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578be25-1e18-4464-a4c9-922eba73f914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:21.583878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578be25-1e18-4464-a4c9-922eba73f914 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:21.584479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578be25-1e18-4464-a4c9-922eba73f914 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:21.585217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578be25-1e18-4464-a4c9-922eba73f914 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:21.587062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578be25-1e18-4464-a4c9-922eba73f914 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:21.587593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578be25-1e18-4464-a4c9-922eba73f914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:21.590685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578be25-1e18-4464-a4c9-922eba73f914 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:21.595495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35f4f1-b10d-4f46-9696-9f5ea7d60464 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:21.598721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 460/933] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:21.603123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578be25-1e18-4464-a4c9-922eba73f914 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:21.639253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f201dae-4b51-4b27-a38c-6bdce4436394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:21.639831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f201dae-4b51-4b27-a38c-6bdce4436394 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:21.640119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f201dae-4b51-4b27-a38c-6bdce4436394 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:21.640442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f201dae-4b51-4b27-a38c-6bdce4436394 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:21.641195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f201dae-4b51-4b27-a38c-6bdce4436394 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:21.641486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f201dae-4b51-4b27-a38c-6bdce4436394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:21.642960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f201dae-4b51-4b27-a38c-6bdce4436394 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:21.656651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 474/934] 10.222.0.15 () {56 vars in 1115 bytes} [Thu May 26 03:05:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:21.658753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f201dae-4b51-4b27-a38c-6bdce4436394 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:21.669968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:21.673809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:21.731328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578be25-1e18-4464-a4c9-922eba73f914 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:21.771379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fee8a3-8b78-466c-a904-f99627c437af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:21.772348 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fee8a3-8b78-466c-a904-f99627c437af None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:21.772786 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fee8a3-8b78-466c-a904-f99627c437af None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:21.773210 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fee8a3-8b78-466c-a904-f99627c437af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:21.774113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fee8a3-8b78-466c-a904-f99627c437af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:21.775671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fee8a3-8b78-466c-a904-f99627c437af None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:21.784453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f201dae-4b51-4b27-a38c-6bdce4436394 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:21.821514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f384856-c9da-4ded-ae8b-f04939b842e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:21.822898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f384856-c9da-4ded-ae8b-f04939b842e8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:21.823191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f384856-c9da-4ded-ae8b-f04939b842e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:21.823468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f384856-c9da-4ded-ae8b-f04939b842e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:21.834566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f384856-c9da-4ded-ae8b-f04939b842e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:21.837289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f384856-c9da-4ded-ae8b-f04939b842e8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6f384856-c9da-4ded-ae8b-f04939b842e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:21.853993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:21.855038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:21.855943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:21.855943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:21.855943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:21.855943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:21.855943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 475/935] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:21.861674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f384856-c9da-4ded-ae8b-f04939b842e8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:21.900828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 461/936] 10.222.0.15 () {60 vars in 1144 bytes} [Thu May 26 03:05:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:05:21.930953 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:21.975666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f384856-c9da-4ded-ae8b-f04939b842e8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:22.020736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fde206-29a4-4003-9d64-e10e3cc4450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:22.021421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fde206-29a4-4003-9d64-e10e3cc4450a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:22.021705 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fde206-29a4-4003-9d64-e10e3cc4450a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:22.021981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fde206-29a4-4003-9d64-e10e3cc4450a None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:22.022708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fde206-29a4-4003-9d64-e10e3cc4450a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:22.023015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fde206-29a4-4003-9d64-e10e3cc4450a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:22.024417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fde206-29a4-4003-9d64-e10e3cc4450a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:22.039225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 476/937] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:22.045679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fee8a3-8b78-466c-a904-f99627c437af None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:22.159180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fee8a3-8b78-466c-a904-f99627c437af None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:22.162345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:22.194281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0288b-a6ca-4667-b120-c1858783fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:22.195102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0288b-a6ca-4667-b120-c1858783fcbd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:22.195386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0288b-a6ca-4667-b120-c1858783fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:22.195663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0288b-a6ca-4667-b120-c1858783fcbd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:22.203720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0288b-a6ca-4667-b120-c1858783fcbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:22.205232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0288b-a6ca-4667-b120-c1858783fcbd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-24a0288b-a6ca-4667-b120-c1858783fcbd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:22.221152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:22.222128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:22.223465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 462/938] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:05:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:22.228513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fde206-29a4-4003-9d64-e10e3cc4450a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:22.337526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fde206-29a4-4003-9d64-e10e3cc4450a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:22.372377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:22.374126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ebe89-56c2-4dc5-9a4a-01f1e7edf9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:22.374810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ebe89-56c2-4dc5-9a4a-01f1e7edf9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:22.375380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ebe89-56c2-4dc5-9a4a-01f1e7edf9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:22.375655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ebe89-56c2-4dc5-9a4a-01f1e7edf9d0 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:22.376520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ebe89-56c2-4dc5-9a4a-01f1e7edf9d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:22.376834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ebe89-56c2-4dc5-9a4a-01f1e7edf9d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:22.378318 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ebe89-56c2-4dc5-9a4a-01f1e7edf9d0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:22.396920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 477/939] 10.222.0.15 () {56 vars in 1149 bytes} [Thu May 26 03:05:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:22.402981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0288b-a6ca-4667-b120-c1858783fcbd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:22.502773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104612a-ddee-45ca-b3d0-c7f3f8510a08 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:22.503283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104612a-ddee-45ca-b3d0-c7f3f8510a08 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:22.503359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104612a-ddee-45ca-b3d0-c7f3f8510a08 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:22.505087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 478/940] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:22.511707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6bc61-ac33-4799-90e7-0b844a717b8b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:22.512223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6bc61-ac33-4799-90e7-0b844a717b8b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:22.512720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6bc61-ac33-4799-90e7-0b844a717b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:22.516483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0288b-a6ca-4667-b120-c1858783fcbd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:22.530208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-cbc6bc61-ac33-4799-90e7-0b844a717b8b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:22.531498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cbc6bc61-ac33-4799-90e7-0b844a717b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:22.553733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632c9ee-24fe-42a1-9007-155e3d7dfd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:22.554533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632c9ee-24fe-42a1-9007-155e3d7dfd31 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:22.554813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632c9ee-24fe-42a1-9007-155e3d7dfd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:22.555519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632c9ee-24fe-42a1-9007-155e3d7dfd31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:22.567424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632c9ee-24fe-42a1-9007-155e3d7dfd31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:22.569004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632c9ee-24fe-42a1-9007-155e3d7dfd31 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f632c9ee-24fe-42a1-9007-155e3d7dfd31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:22.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:22.589581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:22.590951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:22.590951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:22.590951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:22.590951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:22.590951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 463/941] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:22.595796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632c9ee-24fe-42a1-9007-155e3d7dfd31 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:22.612404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 479/942] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:22.615469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:22.630951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6bc61-ac33-4799-90e7-0b844a717b8b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:22.733390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632c9ee-24fe-42a1-9007-155e3d7dfd31 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:22.745979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6bc61-ac33-4799-90e7-0b844a717b8b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:22.754657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:22.781877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dc128-5877-4fdd-a7e4-d36eb469281d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:22.782551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dc128-5877-4fdd-a7e4-d36eb469281d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:22.782838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dc128-5877-4fdd-a7e4-d36eb469281d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:22.783167 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dc128-5877-4fdd-a7e4-d36eb469281d None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:22.783282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:22.784180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:22.784691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:22.785150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dc128-5877-4fdd-a7e4-d36eb469281d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:22.785379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:22.785479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dc128-5877-4fdd-a7e4-d36eb469281d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:22.786373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:22.786876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dc128-5877-4fdd-a7e4-d36eb469281d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:22.788248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:22.790030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WARNING keystone.server.flask.common [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 03:05:22.814964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 464/943] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:22.822986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dc128-5877-4fdd-a7e4-d36eb469281d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:22.846379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.sql.core [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 03:05:22.846379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 03:05:22.846379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [parameters: {'id': 'a3000d379c95448f9681772ca2f4a0ae', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 03:05:22.846379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80615) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a3000d379c95448f9681772ca2f4a0ae.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a3000d379c95448f9681772ca2f4a0ae. May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application result = self._query(query) May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application conn.query(q) May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 03:05:22.870897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application result.read() May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 03:05:22.871838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application next(self.gen) May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application yield resource May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application next(self.gen) May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.session.rollback() May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.force_reraise() May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise self.value May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application session.commit() May 26 03:05:22.872981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._prepare_impl() May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.session.flush() May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._flush(objects) May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application compat.raise_( May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application flush_context.execute() May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 03:05:22.873901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rec.execute(self) May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 03:05:22.874879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application result = self._query(query) May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application conn.query(q) May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application result.read() May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 03:05:22.875693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [parameters: {'id': 'a3000d379c95448f9681772ca2f4a0ae', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:22.876803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:22.877770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:22.878915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:22.878915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 03:05:22.878915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 03:05:22.878915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:22.878915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:22.878915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 03:05:22.878915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 03:05:22.878915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a3000d379c95448f9681772ca2f4a0ae. May 26 03:05:22.878915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:22.885447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 480/944] 10.222.0.15 () {60 vars in 1140 bytes} [Thu May 26 03:05:22 2022] POST /identity/v3/projects => generated 262 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:22.888936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:22.923969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:22.955251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dc128-5877-4fdd-a7e4-d36eb469281d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:23.004755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7888b54-2e13-4976-ae58-671ed55ccec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:23.005624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7888b54-2e13-4976-ae58-671ed55ccec2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.006026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7888b54-2e13-4976-ae58-671ed55ccec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.006314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7888b54-2e13-4976-ae58-671ed55ccec2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.014325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7888b54-2e13-4976-ae58-671ed55ccec2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:23.016059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7888b54-2e13-4976-ae58-671ed55ccec2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:23.017587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54e3e0-9be1-4a67-8c23-51131df9cbce None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b7888b54-2e13-4976-ae58-671ed55ccec2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:23.031642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:23.032603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:23.033517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:23.033517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:23.033517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:23.033517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:23.033517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:23.033517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:23.033517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:23.033517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:23.036087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 465/945] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:23.042797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7888b54-2e13-4976-ae58-671ed55ccec2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:23.060524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bc627-582e-430e-97c2-e8ab42f0b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:23.061629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc627-582e-430e-97c2-e8ab42f0b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.062131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc627-582e-430e-97c2-e8ab42f0b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.062608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc627-582e-430e-97c2-e8ab42f0b9f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.070115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bc627-582e-430e-97c2-e8ab42f0b9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:23.072038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bc627-582e-430e-97c2-e8ab42f0b9f9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-236bc627-582e-430e-97c2-e8ab42f0b9f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:23.086361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:23.087257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:23.088188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:23.088188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:23.088188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:23.088188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:23.088188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:23.088188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:23.088188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:23.088188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:23.090909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 481/946] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:23.096431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bc627-582e-430e-97c2-e8ab42f0b9f9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:23.126797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:23.171251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7888b54-2e13-4976-ae58-671ed55ccec2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:23.208223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bc627-582e-430e-97c2-e8ab42f0b9f9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:23.210477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc2472-4c80-4994-8055-328d5aa2b893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:23.211589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc2472-4c80-4994-8055-328d5aa2b893 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.212020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc2472-4c80-4994-8055-328d5aa2b893 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.212500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc2472-4c80-4994-8055-328d5aa2b893 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.213984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc2472-4c80-4994-8055-328d5aa2b893 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:23.214450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc2472-4c80-4994-8055-328d5aa2b893 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:23.216034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc2472-4c80-4994-8055-328d5aa2b893 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:23.219067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:23.230105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 466/947] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:23.232427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c013-a293-44d4-853a-cc947b6d37eb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.232427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c013-a293-44d4-853a-cc947b6d37eb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.232427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c013-a293-44d4-853a-cc947b6d37eb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.233839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 467/948] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:23.238862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ee14c-96fc-46bf-a7ca-2270a74264cd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.239149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ee14c-96fc-46bf-a7ca-2270a74264cd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.239499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ee14c-96fc-46bf-a7ca-2270a74264cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.248208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84ac33-e49b-42eb-8782-1434e750ad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:23.248902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84ac33-e49b-42eb-8782-1434e750ad07 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.249185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84ac33-e49b-42eb-8782-1434e750ad07 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.249459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84ac33-e49b-42eb-8782-1434e750ad07 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.250210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84ac33-e49b-42eb-8782-1434e750ad07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:23.250517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84ac33-e49b-42eb-8782-1434e750ad07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:23.251940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84ac33-e49b-42eb-8782-1434e750ad07 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:23.256515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8d2ee14c-96fc-46bf-a7ca-2270a74264cd None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:23.257655 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8d2ee14c-96fc-46bf-a7ca-2270a74264cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:23.272106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 482/949] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:23.272940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84ac33-e49b-42eb-8782-1434e750ad07 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:23.342470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 468/950] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:23.366068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ee14c-96fc-46bf-a7ca-2270a74264cd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:23.383771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:23.410085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84ac33-e49b-42eb-8782-1434e750ad07 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:23.466572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe69a01-876e-466e-b5c9-3146dbbe003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:23.468031 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69a01-876e-466e-b5c9-3146dbbe003c None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.469065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69a01-876e-466e-b5c9-3146dbbe003c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.469536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69a01-876e-466e-b5c9-3146dbbe003c None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/c3df8c2dd7194952abaa8658bbacd56f/roles/d37e7ae615d44a709c874db9d5fa0d2f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.472674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe69a01-876e-466e-b5c9-3146dbbe003c None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=c3df8c2dd7194952abaa8658bbacd56f, role_id=d37e7ae615d44a709c874db9d5fa0d2f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:23.474328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe69a01-876e-466e-b5c9-3146dbbe003c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:23.490764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ee14c-96fc-46bf-a7ca-2270a74264cd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:23.517990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:23.527673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316225-a142-4f58-a22d-fef16ee3818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:23.528501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316225-a142-4f58-a22d-fef16ee3818d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.528792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316225-a142-4f58-a22d-fef16ee3818d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.529063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316225-a142-4f58-a22d-fef16ee3818d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.529718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316225-a142-4f58-a22d-fef16ee3818d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:23.531188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316225-a142-4f58-a22d-fef16ee3818d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:23.539487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 483/951] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:05:23 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/c3df8c2dd7194952abaa8658bbacd56f/roles/d37e7ae615d44a709c874db9d5fa0d2f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b8316225-a142-4f58-a22d-fef16ee3818d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:23.543668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:23.547056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:23.547963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 469/952] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:23.553403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe69a01-876e-466e-b5c9-3146dbbe003c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:23.672260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe69a01-876e-466e-b5c9-3146dbbe003c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:23.715753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395afd9-910a-41ef-96fe-6e591b455c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:23.716881 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395afd9-910a-41ef-96fe-6e591b455c9e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.717366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395afd9-910a-41ef-96fe-6e591b455c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.717848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395afd9-910a-41ef-96fe-6e591b455c9e None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.718755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395afd9-910a-41ef-96fe-6e591b455c9e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:23.719258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395afd9-910a-41ef-96fe-6e591b455c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:23.720874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395afd9-910a-41ef-96fe-6e591b455c9e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:23.727004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 484/953] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:23.732335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316225-a142-4f58-a22d-fef16ee3818d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:23.854889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316225-a142-4f58-a22d-fef16ee3818d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:23.889825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43e2f1-2546-44ce-9317-fda784746bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:23.890491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43e2f1-2546-44ce-9317-fda784746bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:23.890857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43e2f1-2546-44ce-9317-fda784746bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:23.891146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43e2f1-2546-44ce-9317-fda784746bc4 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:23.891852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43e2f1-2546-44ce-9317-fda784746bc4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:23.892157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43e2f1-2546-44ce-9317-fda784746bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:23.893563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43e2f1-2546-44ce-9317-fda784746bc4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:23.898930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 470/954] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:23.909402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395afd9-910a-41ef-96fe-6e591b455c9e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:23.918845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:24.015391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395afd9-910a-41ef-96fe-6e591b455c9e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:24.050156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1fd34-17ba-492a-9898-b528afaa5a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:24.050736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1fd34-17ba-492a-9898-b528afaa5a96 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:24.051018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1fd34-17ba-492a-9898-b528afaa5a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:24.051288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1fd34-17ba-492a-9898-b528afaa5a96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:24.052012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1fd34-17ba-492a-9898-b528afaa5a96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:24.053411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1fd34-17ba-492a-9898-b528afaa5a96 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:24.151291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 485/955] 10.222.0.15 () {60 vars in 1144 bytes} [Thu May 26 03:05:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:24.306254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991491-ce36-4f4c-b570-48921152ec3c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:24.307117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991491-ce36-4f4c-b570-48921152ec3c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:24.307319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991491-ce36-4f4c-b570-48921152ec3c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:24.308983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 471/956] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:24.314857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8464eb-d4f0-4705-b257-39c4f2c2f599 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:24.315427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8464eb-d4f0-4705-b257-39c4f2c2f599 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:24.315902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8464eb-d4f0-4705-b257-39c4f2c2f599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:24.334208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-be8464eb-d4f0-4705-b257-39c4f2c2f599 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:24.336477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-be8464eb-d4f0-4705-b257-39c4f2c2f599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:24.398549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:24.415769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 486/957] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:24.438831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f991491-ce36-4f4c-b570-48921152ec3c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:24.500673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:24.546673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f991491-ce36-4f4c-b570-48921152ec3c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:24.581116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446043-4039-4a65-81f1-351b992b0cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:24.581830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446043-4039-4a65-81f1-351b992b0cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:24.582113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446043-4039-4a65-81f1-351b992b0cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:24.582386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446043-4039-4a65-81f1-351b992b0cd1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:24.583036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e446043-4039-4a65-81f1-351b992b0cd1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:24.584447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e446043-4039-4a65-81f1-351b992b0cd1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4e446043-4039-4a65-81f1-351b992b0cd1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:24.597121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:24.598199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:24.599057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 472/958] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:24.605485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8464eb-d4f0-4705-b257-39c4f2c2f599 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:24.713395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8464eb-d4f0-4705-b257-39c4f2c2f599 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:24.748834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91eff53-422e-4c85-a1ac-fda8790a1265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:24.749503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eff53-422e-4c85-a1ac-fda8790a1265 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:24.749785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eff53-422e-4c85-a1ac-fda8790a1265 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:24.750065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eff53-422e-4c85-a1ac-fda8790a1265 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:24.750768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91eff53-422e-4c85-a1ac-fda8790a1265 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:24.751074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91eff53-422e-4c85-a1ac-fda8790a1265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:24.752468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91eff53-422e-4c85-a1ac-fda8790a1265 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:24.757799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 487/959] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:24.763417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446043-4039-4a65-81f1-351b992b0cd1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:24.867600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446043-4039-4a65-81f1-351b992b0cd1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:24.884676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:24.901826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93e99e-ca64-41b0-a24f-7ba79c720b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:24.902494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93e99e-ca64-41b0-a24f-7ba79c720b23 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:24.902777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93e99e-ca64-41b0-a24f-7ba79c720b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:24.903049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93e99e-ca64-41b0-a24f-7ba79c720b23 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:24.903751 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93e99e-ca64-41b0-a24f-7ba79c720b23 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:24.904060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93e99e-ca64-41b0-a24f-7ba79c720b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:24.905454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93e99e-ca64-41b0-a24f-7ba79c720b23 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:24.910039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 473/960] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:25.724966 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4060-c6ae-44a5-a857-0f01cbcae516 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:25.725563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4060-c6ae-44a5-a857-0f01cbcae516 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:25.725752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4060-c6ae-44a5-a857-0f01cbcae516 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:25.727440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 488/961] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:25.732830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c127-a37a-41f6-a857-8127d608368f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:25.733295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c127-a37a-41f6-a857-8127d608368f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:25.733501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c127-a37a-41f6-a857-8127d608368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:25.750768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ece7c127-a37a-41f6-a857-8127d608368f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:25.751936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ece7c127-a37a-41f6-a857-8127d608368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:25.812133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d89a0-04ae-40ac-a5b2-3a7031a55a1c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:25.812844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d89a0-04ae-40ac-a5b2-3a7031a55a1c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:25.813385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d89a0-04ae-40ac-a5b2-3a7031a55a1c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:25.815337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 489/962] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:25.820554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852270a-adbc-4275-b8cc-6d273f01b85b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:25.821078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852270a-adbc-4275-b8cc-6d273f01b85b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:25.821659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852270a-adbc-4275-b8cc-6d273f01b85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:25.834657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 474/963] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:25.841312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6852270a-adbc-4275-b8cc-6d273f01b85b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:25.842748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6852270a-adbc-4275-b8cc-6d273f01b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:25.860048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c127-a37a-41f6-a857-8127d608368f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:25.896535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:25.924447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 490/964] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:25.943158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852270a-adbc-4275-b8cc-6d273f01b85b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:25.985055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c127-a37a-41f6-a857-8127d608368f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:26.004215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:26.034612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:26.035540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.035972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.043856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.043856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:26.043856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:26.043856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING keystone.server.flask.common [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 03:05:26.051166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852270a-adbc-4275-b8cc-6d273f01b85b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:26.087208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.sql.core [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 03:05:26.087208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 03:05:26.087208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [parameters: {'user_id': '63273522c17b4542bdcbda29d2909734', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 03:05:26.087208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80614) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 03:05:26.089879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ef7a3-6321-46cb-bf53-61642d90f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:26.090857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ef7a3-6321-46cb-bf53-61642d90f927 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.091242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ef7a3-6321-46cb-bf53-61642d90f927 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.091648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ef7a3-6321-46cb-bf53-61642d90f927 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = self._query(query) May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application conn.query(q) May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result.read() May 26 03:05:26.098017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 03:05:26.099074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application next(self.gen) May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application yield resource May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application next(self.gen) May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.session.rollback() May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.force_reraise() May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise self.value May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application session.commit() May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 03:05:26.100262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._prepare_impl() May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.session.flush() May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._flush(objects) May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application compat.raise_( May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application flush_context.execute() May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rec.execute(self) May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 03:05:26.101413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 03:05:26.102518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = self._query(query) May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application conn.query(q) May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result.read() May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 03:05:26.104270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [parameters: {'user_id': '63273522c17b4542bdcbda29d2909734', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:26.106482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 03:05:26.108647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 03:05:26.112928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 03:05:26.112928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 03:05:26.112928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 03:05:26.112928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 03:05:26.112928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 03:05:26.112928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:26.112928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 475/965] 10.222.0.15 () {60 vars in 1131 bytes} [Thu May 26 03:05:25 2022] POST /identity/v3/users => generated 160 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:26.115637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ef7a3-6321-46cb-bf53-61642d90f927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:26.117912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-844ef7a3-6321-46cb-bf53-61642d90f927 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:26.124629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:26.125574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:26.126415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:26.131003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 491/966] 10.222.0.15 () {56 vars in 1120 bytes} [Thu May 26 03:05:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:26.131898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ef7a3-6321-46cb-bf53-61642d90f927 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:26.180214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:26.247800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ef7a3-6321-46cb-bf53-61642d90f927 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:26.252658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646e2dc-2a87-4899-8dd5-f0b0e79b7ddd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:26.291431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bc87f-c1e7-4e41-9637-b9f2aa698461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:26.292578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bc87f-c1e7-4e41-9637-b9f2aa698461 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.292740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bc87f-c1e7-4e41-9637-b9f2aa698461 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.293136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bc87f-c1e7-4e41-9637-b9f2aa698461 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.298627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ef213-6858-4027-a1e6-087518820e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:26.299526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ef213-6858-4027-a1e6-087518820e04 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.300001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ef213-6858-4027-a1e6-087518820e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.300617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ef213-6858-4027-a1e6-087518820e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.301561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bc87f-c1e7-4e41-9637-b9f2aa698461 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:26.301844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ef213-6858-4027-a1e6-087518820e04 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:26.302332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ef213-6858-4027-a1e6-087518820e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:26.303472 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bc87f-c1e7-4e41-9637-b9f2aa698461 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:26.304069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ef213-6858-4027-a1e6-087518820e04 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:26.314536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 492/967] 10.222.0.15 () {56 vars in 1115 bytes} [Thu May 26 03:05:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:26.319783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ef213-6858-4027-a1e6-087518820e04 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ce5bc87f-c1e7-4e41-9637-b9f2aa698461 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:26.321635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:26.322616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 03:05:26.323586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:26.327637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 476/968] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:05:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:26.328529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bc87f-c1e7-4e41-9637-b9f2aa698461 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:26.375894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:26.439608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ef213-6858-4027-a1e6-087518820e04 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:26.443597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:26.456828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bc87f-c1e7-4e41-9637-b9f2aa698461 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:26.482757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a855d3f-6660-4af0-99c8-f2e788c4f4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:26.483563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a855d3f-6660-4af0-99c8-f2e788c4f4fb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.483838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a855d3f-6660-4af0-99c8-f2e788c4f4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.484115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a855d3f-6660-4af0-99c8-f2e788c4f4fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.493418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e773d-4ab7-4afe-96a5-98431a8eb1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:26.494390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e773d-4ab7-4afe-96a5-98431a8eb1ff None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.494634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a855d3f-6660-4af0-99c8-f2e788c4f4fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:26.494781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e773d-4ab7-4afe-96a5-98431a8eb1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.494953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e773d-4ab7-4afe-96a5-98431a8eb1ff None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.495730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e773d-4ab7-4afe-96a5-98431a8eb1ff None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:26.496040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e773d-4ab7-4afe-96a5-98431a8eb1ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:26.496155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a855d3f-6660-4af0-99c8-f2e788c4f4fb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:26.497494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e773d-4ab7-4afe-96a5-98431a8eb1ff None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-3a855d3f-6660-4af0-99c8-f2e788c4f4fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:26.515100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:26.516192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:26.517140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:26.517140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:26.517140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:26.517140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:26.517140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 493/969] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:26.517468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d058ef-944d-4a75-9bf9-ed210ef79b3e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.517750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d058ef-944d-4a75-9bf9-ed210ef79b3e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.518023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d058ef-944d-4a75-9bf9-ed210ef79b3e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.520340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 494/970] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:26.525727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d058ef-944d-4a75-9bf9-ed210ef79b3e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:26.552339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 477/971] 10.222.0.15 () {56 vars in 1101 bytes} [Thu May 26 03:05:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:26.552339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9e44-4ea5-4dde-9c14-326cb92f5e7d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.552339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9e44-4ea5-4dde-9c14-326cb92f5e7d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.552339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9e44-4ea5-4dde-9c14-326cb92f5e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.577085 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7e1a9e44-4ea5-4dde-9c14-326cb92f5e7d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:26.579178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7e1a9e44-4ea5-4dde-9c14-326cb92f5e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:26.642505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d058ef-944d-4a75-9bf9-ed210ef79b3e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:26.671057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 478/972] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:26.689155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34047bfe-44a9-46da-a46e-9013256a7b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:26.689983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34047bfe-44a9-46da-a46e-9013256a7b8e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.690264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34047bfe-44a9-46da-a46e-9013256a7b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.690592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34047bfe-44a9-46da-a46e-9013256a7b8e None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.691331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34047bfe-44a9-46da-a46e-9013256a7b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:26.691687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34047bfe-44a9-46da-a46e-9013256a7b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:26.693126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34047bfe-44a9-46da-a46e-9013256a7b8e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:26.695450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9e44-4ea5-4dde-9c14-326cb92f5e7d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:26.708105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 495/973] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:26.714268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34047bfe-44a9-46da-a46e-9013256a7b8e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:26.723933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:26.734032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:26.829576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9e44-4ea5-4dde-9c14-326cb92f5e7d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:26.843805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34047bfe-44a9-46da-a46e-9013256a7b8e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:26.875701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907ee69-aa3c-4fb6-bfdd-e35b6acad97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:26.877040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907ee69-aa3c-4fb6-bfdd-e35b6acad97c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.877474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907ee69-aa3c-4fb6-bfdd-e35b6acad97c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.878068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907ee69-aa3c-4fb6-bfdd-e35b6acad97c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.879261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907ee69-aa3c-4fb6-bfdd-e35b6acad97c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:26.881630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907ee69-aa3c-4fb6-bfdd-e35b6acad97c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:26.886602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782d06c-c183-46ab-b250-ec095ce01cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:26.887424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782d06c-c183-46ab-b250-ec095ce01cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:26.887706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782d06c-c183-46ab-b250-ec095ce01cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:26.887981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782d06c-c183-46ab-b250-ec095ce01cd6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1907ee69-aa3c-4fb6-bfdd-e35b6acad97c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:26.894518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:26.895673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:26.896578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 479/974] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:26.897831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782d06c-c183-46ab-b250-ec095ce01cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:26.899305 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782d06c-c183-46ab-b250-ec095ce01cd6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:26.902275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907ee69-aa3c-4fb6-bfdd-e35b6acad97c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e782d06c-c183-46ab-b250-ec095ce01cd6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:26.916378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:26.917378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:26.918417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 496/975] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:05:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:26.923279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782d06c-c183-46ab-b250-ec095ce01cd6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:26.998188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:27.012180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:27.016610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907ee69-aa3c-4fb6-bfdd-e35b6acad97c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.039138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782d06c-c183-46ab-b250-ec095ce01cd6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.050748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ff79b-c757-4a36-8216-a066f190f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.051415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ff79b-c757-4a36-8216-a066f190f9fb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.051693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ff79b-c757-4a36-8216-a066f190f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.051979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ff79b-c757-4a36-8216-a066f190f9fb None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.052723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ff79b-c757-4a36-8216-a066f190f9fb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:27.053034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ff79b-c757-4a36-8216-a066f190f9fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.054473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ff79b-c757-4a36-8216-a066f190f9fb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:27.061094 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 480/976] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:27.067000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ff79b-c757-4a36-8216-a066f190f9fb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:27.081591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47538089-2e30-4efb-84ad-36e2e2bfed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.082271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47538089-2e30-4efb-84ad-36e2e2bfed11 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.082559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47538089-2e30-4efb-84ad-36e2e2bfed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.082842 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47538089-2e30-4efb-84ad-36e2e2bfed11 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.083680 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47538089-2e30-4efb-84ad-36e2e2bfed11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:27.083993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47538089-2e30-4efb-84ad-36e2e2bfed11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.085739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47538089-2e30-4efb-84ad-36e2e2bfed11 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:27.103876 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 497/977] 10.222.0.15 () {56 vars in 1149 bytes} [Thu May 26 03:05:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:27.109333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47538089-2e30-4efb-84ad-36e2e2bfed11 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:27.172635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ff79b-c757-4a36-8216-a066f190f9fb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.206830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d872f5b-b250-4754-92b3-ac511081e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.207493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d872f5b-b250-4754-92b3-ac511081e3bb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.207774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d872f5b-b250-4754-92b3-ac511081e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.208049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d872f5b-b250-4754-92b3-ac511081e3bb None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.208252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47538089-2e30-4efb-84ad-36e2e2bfed11 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.208783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d872f5b-b250-4754-92b3-ac511081e3bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:27.209091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d872f5b-b250-4754-92b3-ac511081e3bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.210715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d872f5b-b250-4754-92b3-ac511081e3bb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:27.215446 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 481/978] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:27.216750 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd754d-28f6-4715-aac2-a7002459dd4d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.217039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd754d-28f6-4715-aac2-a7002459dd4d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.217313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd754d-28f6-4715-aac2-a7002459dd4d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.218687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 482/979] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:27.221133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd754d-28f6-4715-aac2-a7002459dd4d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:27.236542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:27.241873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3773cf7-b0a7-4849-81e8-bd0648267645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.242525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3773cf7-b0a7-4849-81e8-bd0648267645 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.242808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3773cf7-b0a7-4849-81e8-bd0648267645 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.243121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3773cf7-b0a7-4849-81e8-bd0648267645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.246308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:27.310645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3773cf7-b0a7-4849-81e8-bd0648267645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.312107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3773cf7-b0a7-4849-81e8-bd0648267645 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:27.323385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd754d-28f6-4715-aac2-a7002459dd4d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.357780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262443e2-4f02-40ab-aa9f-59d81f1417ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.358424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262443e2-4f02-40ab-aa9f-59d81f1417ae None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.358706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262443e2-4f02-40ab-aa9f-59d81f1417ae None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.358982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262443e2-4f02-40ab-aa9f-59d81f1417ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.359777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262443e2-4f02-40ab-aa9f-59d81f1417ae None admin] RBAC: Adding query filter params (interface=admin, service_id=cb2c8b24b5b3488a8b817e4909951432, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:27.360091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262443e2-4f02-40ab-aa9f-59d81f1417ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.361535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262443e2-4f02-40ab-aa9f-59d81f1417ae None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:27.366684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 483/980] 10.222.0.15 () {56 vars in 1249 bytes} [Thu May 26 03:05:27 2022] GET /identity/v3/endpoints?service_id=cb2c8b24b5b3488a8b817e4909951432&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:27.367673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1423c0-5bde-4a18-a294-8759dc4069f2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.367960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1423c0-5bde-4a18-a294-8759dc4069f2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.368243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1423c0-5bde-4a18-a294-8759dc4069f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.384452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ac1423c0-5bde-4a18-a294-8759dc4069f2 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:27.385632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ac1423c0-5bde-4a18-a294-8759dc4069f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:27.410598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 498/981] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:27 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 03:05:27.411289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3773cf7-b0a7-4849-81e8-bd0648267645 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:27.446684 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:27.450749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 484/982] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:27.451637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1423c0-5bde-4a18-a294-8759dc4069f2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:27.465399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:27.512655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3773cf7-b0a7-4849-81e8-bd0648267645 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.546806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f262-f45c-4dd3-b14f-b58ab2aabc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.547464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f262-f45c-4dd3-b14f-b58ab2aabc45 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.547750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f262-f45c-4dd3-b14f-b58ab2aabc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.548027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f262-f45c-4dd3-b14f-b58ab2aabc45 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.548726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4f262-f45c-4dd3-b14f-b58ab2aabc45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.550046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1423c0-5bde-4a18-a294-8759dc4069f2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.550156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4f262-f45c-4dd3-b14f-b58ab2aabc45 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:27.556033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 499/983] 10.222.0.15 () {56 vars in 1087 bytes} [Thu May 26 03:05:27 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:05:27.557362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f262-f45c-4dd3-b14f-b58ab2aabc45 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:27.600889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93461c-d42e-4679-9ffa-6dedbf20eb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.601620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93461c-d42e-4679-9ffa-6dedbf20eb47 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.601907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93461c-d42e-4679-9ffa-6dedbf20eb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.602187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93461c-d42e-4679-9ffa-6dedbf20eb47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.618085 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93461c-d42e-4679-9ffa-6dedbf20eb47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.620874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93461c-d42e-4679-9ffa-6dedbf20eb47 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9a93461c-d42e-4679-9ffa-6dedbf20eb47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:27.640381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:27.641387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:27.642307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:27.642307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:27.642307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:27.642307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:27.642307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 485/984] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:27.647364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93461c-d42e-4679-9ffa-6dedbf20eb47 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:27.674583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:27.679059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f262-f45c-4dd3-b14f-b58ab2aabc45 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.714465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:27.718111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4711fd-c71e-4dd0-8fcc-f5e086960418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.718799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4711fd-c71e-4dd0-8fcc-f5e086960418 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.719089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4711fd-c71e-4dd0-8fcc-f5e086960418 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.719369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4711fd-c71e-4dd0-8fcc-f5e086960418 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.720104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4711fd-c71e-4dd0-8fcc-f5e086960418 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.721548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4711fd-c71e-4dd0-8fcc-f5e086960418 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:27.756294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93461c-d42e-4679-9ffa-6dedbf20eb47 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.793148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ca2d-9d82-4b2a-b7ec-2f7fdc423030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.793983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ca2d-9d82-4b2a-b7ec-2f7fdc423030 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.794266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ca2d-9d82-4b2a-b7ec-2f7fdc423030 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.794542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90ca2d-9d82-4b2a-b7ec-2f7fdc423030 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.795357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90ca2d-9d82-4b2a-b7ec-2f7fdc423030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:27.795599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90ca2d-9d82-4b2a-b7ec-2f7fdc423030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.797013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90ca2d-9d82-4b2a-b7ec-2f7fdc423030 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:27.812352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 500/985] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:05:27 2022] POST /identity/v3/services => generated 242 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:27.816925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 486/986] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:27.822830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4711fd-c71e-4dd0-8fcc-f5e086960418 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:27.943617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4711fd-c71e-4dd0-8fcc-f5e086960418 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:27.981239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd085d3e-1cb6-43c5-8da0-80cdebe41cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:27.982050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd085d3e-1cb6-43c5-8da0-80cdebe41cec None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:27.982335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd085d3e-1cb6-43c5-8da0-80cdebe41cec None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:27.982613 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd085d3e-1cb6-43c5-8da0-80cdebe41cec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:27.989890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd085d3e-1cb6-43c5-8da0-80cdebe41cec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:27.991339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd085d3e-1cb6-43c5-8da0-80cdebe41cec None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-dd085d3e-1cb6-43c5-8da0-80cdebe41cec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:28.005396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:28.006317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:28.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:28.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:28.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:28.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:28.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:28.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:28.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:28.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:28.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 501/987] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:28.013151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ca2d-9d82-4b2a-b7ec-2f7fdc423030 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:28.116770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90ca2d-9d82-4b2a-b7ec-2f7fdc423030 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:28.136561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:28.150900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aa0e2-8e03-4917-86c7-bb7c3799942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:28.151614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aa0e2-8e03-4917-86c7-bb7c3799942c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:28.151899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aa0e2-8e03-4917-86c7-bb7c3799942c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:28.152174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aa0e2-8e03-4917-86c7-bb7c3799942c None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:28.152981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aa0e2-8e03-4917-86c7-bb7c3799942c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:28.153292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aa0e2-8e03-4917-86c7-bb7c3799942c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:28.154712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aa0e2-8e03-4917-86c7-bb7c3799942c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:28.166726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 487/988] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:28.172382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd085d3e-1cb6-43c5-8da0-80cdebe41cec None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:28.189156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:28.274447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd085d3e-1cb6-43c5-8da0-80cdebe41cec None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:28.308825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce157ee-4220-488f-9e29-5ede40b4ae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:28.309708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce157ee-4220-488f-9e29-5ede40b4ae21 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:28.309999 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce157ee-4220-488f-9e29-5ede40b4ae21 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:28.310270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce157ee-4220-488f-9e29-5ede40b4ae21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:28.311090 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce157ee-4220-488f-9e29-5ede40b4ae21 None admin] RBAC: Adding query filter params (role.id=d37e7ae615d44a709c874db9d5fa0d2f, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=c3df8c2dd7194952abaa8658bbacd56f) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:28.311402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce157ee-4220-488f-9e29-5ede40b4ae21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:28.312877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce157ee-4220-488f-9e29-5ede40b4ae21 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:28.319658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 502/989] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:28 2022] GET /identity/v3/role_assignments?user.id=c3df8c2dd7194952abaa8658bbacd56f&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=d37e7ae615d44a709c874db9d5fa0d2f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:29.756336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c907-b8ed-4746-a798-da0d449257aa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:29.756878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c907-b8ed-4746-a798-da0d449257aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:29.756957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c907-b8ed-4746-a798-da0d449257aa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:29.758330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 488/990] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:29.763443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344adf-d473-45ed-a458-080a437b24be None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:29.763819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344adf-d473-45ed-a458-080a437b24be None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:29.763987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344adf-d473-45ed-a458-080a437b24be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:29.780374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0f344adf-d473-45ed-a458-080a437b24be None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:29.781555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0f344adf-d473-45ed-a458-080a437b24be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:29.861553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 503/991] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:29.885079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011c907-b8ed-4746-a798-da0d449257aa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:29.986525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011c907-b8ed-4746-a798-da0d449257aa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:30.020335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400166a6-77bd-41c8-aba1-32672baf8df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:30.021058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400166a6-77bd-41c8-aba1-32672baf8df4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.021344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400166a6-77bd-41c8-aba1-32672baf8df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.021622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400166a6-77bd-41c8-aba1-32672baf8df4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.022272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400166a6-77bd-41c8-aba1-32672baf8df4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:30.023648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400166a6-77bd-41c8-aba1-32672baf8df4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:30.033441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047f4c-6377-40d9-ab2c-68a651291b7b None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.033735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047f4c-6377-40d9-ab2c-68a651291b7b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.034011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047f4c-6377-40d9-ab2c-68a651291b7b None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.035514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 504/992] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-400166a6-77bd-41c8-aba1-32672baf8df4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:30.036035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:30.037115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 03:05:30.037978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:30.041184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5e0d-7af3-4f88-8b7d-cc58684269f8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.041293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 489/993] 10.222.0.15 () {56 vars in 1126 bytes} [Thu May 26 03:05:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:30.041364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5e0d-7af3-4f88-8b7d-cc58684269f8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.041626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab5e0d-7af3-4f88-8b7d-cc58684269f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.043497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400166a6-77bd-41c8-aba1-32672baf8df4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.064464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a6ab5e0d-7af3-4f88-8b7d-cc58684269f8 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:30.065659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a6ab5e0d-7af3-4f88-8b7d-cc58684269f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:30.068589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:30.093772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:30.136989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 505/994] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:30.148449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400166a6-77bd-41c8-aba1-32672baf8df4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:30.159890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab5e0d-7af3-4f88-8b7d-cc58684269f8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.184191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526e23f-af1f-493a-9387-aff8dedd523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:30.184890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526e23f-af1f-493a-9387-aff8dedd523d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.185174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526e23f-af1f-493a-9387-aff8dedd523d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.185458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526e23f-af1f-493a-9387-aff8dedd523d None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.186162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526e23f-af1f-493a-9387-aff8dedd523d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:30.186473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526e23f-af1f-493a-9387-aff8dedd523d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:30.187849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526e23f-af1f-493a-9387-aff8dedd523d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:30.197205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 490/995] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:30.198242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526e23f-af1f-493a-9387-aff8dedd523d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.265652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab5e0d-7af3-4f88-8b7d-cc58684269f8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:30.298010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526e23f-af1f-493a-9387-aff8dedd523d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:30.299441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203b686-2300-4e40-b14c-43b9f3eb1af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:30.300238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b686-2300-4e40-b14c-43b9f3eb1af2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.300554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b686-2300-4e40-b14c-43b9f3eb1af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.300830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b686-2300-4e40-b14c-43b9f3eb1af2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.301471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203b686-2300-4e40-b14c-43b9f3eb1af2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:30.302843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203b686-2300-4e40-b14c-43b9f3eb1af2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:30.307580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a203b686-2300-4e40-b14c-43b9f3eb1af2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:30.314501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:30.315533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:30.316436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 506/996] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:30.321645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203b686-2300-4e40-b14c-43b9f3eb1af2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.324867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:30.338230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0510da0-94b8-48d8-9abb-b362ae98739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:30.338899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0510da0-94b8-48d8-9abb-b362ae98739d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.339184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0510da0-94b8-48d8-9abb-b362ae98739d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.339461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0510da0-94b8-48d8-9abb-b362ae98739d None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.340166 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0510da0-94b8-48d8-9abb-b362ae98739d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:30.340511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0510da0-94b8-48d8-9abb-b362ae98739d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:30.341889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0510da0-94b8-48d8-9abb-b362ae98739d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:30.352522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 491/997] 10.222.0.15 () {56 vars in 1122 bytes} [Thu May 26 03:05:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:30.359069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0510da0-94b8-48d8-9abb-b362ae98739d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.440046 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203b686-2300-4e40-b14c-43b9f3eb1af2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:30.458847 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0510da0-94b8-48d8-9abb-b362ae98739d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:30.476835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c484c7-0546-48a8-adb9-e521dc01ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:30.477691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c484c7-0546-48a8-adb9-e521dc01ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.478168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c484c7-0546-48a8-adb9-e521dc01ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.478695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c484c7-0546-48a8-adb9-e521dc01ccc3 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.479395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c484c7-0546-48a8-adb9-e521dc01ccc3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:30.479699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c484c7-0546-48a8-adb9-e521dc01ccc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:30.481084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c484c7-0546-48a8-adb9-e521dc01ccc3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:30.490795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 507/998] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:30.491662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c484c7-0546-48a8-adb9-e521dc01ccc3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.493469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67905585-fafc-458c-8a43-9b62910b0f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:30.494304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67905585-fafc-458c-8a43-9b62910b0f75 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.494596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67905585-fafc-458c-8a43-9b62910b0f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.495666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67905585-fafc-458c-8a43-9b62910b0f75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.496459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67905585-fafc-458c-8a43-9b62910b0f75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:30.497850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67905585-fafc-458c-8a43-9b62910b0f75 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:30.555278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:30.567359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 492/999] 10.222.0.15 () {60 vars in 1144 bytes} [Thu May 26 03:05:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:05:30.570454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac24c4-41e9-447c-980b-60fa4f0247dd None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.570454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac24c4-41e9-447c-980b-60fa4f0247dd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.570454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac24c4-41e9-447c-980b-60fa4f0247dd None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.570454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 493/1000] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:30.576826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03361f90-c9e7-45f0-88d2-651fcda76a39 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.577117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03361f90-c9e7-45f0-88d2-651fcda76a39 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.577401 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03361f90-c9e7-45f0-88d2-651fcda76a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.593608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c484c7-0546-48a8-adb9-e521dc01ccc3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:30.595989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-03361f90-c9e7-45f0-88d2-651fcda76a39 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:30.597270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-03361f90-c9e7-45f0-88d2-651fcda76a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:30.626653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:30.641085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1502b6-6adc-4bc2-970d-2df23201eebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:30.641770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1502b6-6adc-4bc2-970d-2df23201eebe None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.642071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1502b6-6adc-4bc2-970d-2df23201eebe None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.642419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1502b6-6adc-4bc2-970d-2df23201eebe None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.643144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1502b6-6adc-4bc2-970d-2df23201eebe None admin] RBAC: Adding query filter params (type=compute) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:30.643455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1502b6-6adc-4bc2-970d-2df23201eebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:30.644872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1502b6-6adc-4bc2-970d-2df23201eebe None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:30.656118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 508/1001] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:30.657195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1502b6-6adc-4bc2-970d-2df23201eebe None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.684347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 494/1002] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:30.704334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03361f90-c9e7-45f0-88d2-651fcda76a39 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.768796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1502b6-6adc-4bc2-970d-2df23201eebe None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:30.795130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:30.814497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca3aec-3700-4683-815f-a8a690844d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:30.815346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca3aec-3700-4683-815f-a8a690844d1e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.815631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca3aec-3700-4683-815f-a8a690844d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.815904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca3aec-3700-4683-815f-a8a690844d1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.816748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03361f90-c9e7-45f0-88d2-651fcda76a39 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:30.817161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca3aec-3700-4683-815f-a8a690844d1e None admin] RBAC: Adding query filter params (interface=public, service_id=65bc8b104040474dbae1d11dc8108f34, region_id=RegionOne) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:30.817161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca3aec-3700-4683-815f-a8a690844d1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:30.818594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca3aec-3700-4683-815f-a8a690844d1e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:30.825265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 509/1003] 10.222.0.15 () {56 vars in 1251 bytes} [Thu May 26 03:05:30 2022] GET /identity/v3/endpoints?service_id=65bc8b104040474dbae1d11dc8108f34&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:30.831100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca3aec-3700-4683-815f-a8a690844d1e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.851749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccced01-b939-4fc0-8a0f-0aa0becdde81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:30.852567 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccced01-b939-4fc0-8a0f-0aa0becdde81 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:30.852849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccced01-b939-4fc0-8a0f-0aa0becdde81 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:30.853693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccced01-b939-4fc0-8a0f-0aa0becdde81 None admin] PATH_INFO: `/v3/services/image` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:30.854341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccced01-b939-4fc0-8a0f-0aa0becdde81 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:30.855725 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccced01-b939-4fc0-8a0f-0aa0becdde81 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2ccced01-b939-4fc0-8a0f-0aa0becdde81 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:30.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:30.872073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:30.873216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 495/1004] 10.222.0.15 () {56 vars in 1105 bytes} [Thu May 26 03:05:30 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:30.878122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccced01-b939-4fc0-8a0f-0aa0becdde81 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:30.929083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:30.971231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca3aec-3700-4683-815f-a8a690844d1e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:31.006843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e57baf-6386-4bdc-b9fa-ef2025a596a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:31.007506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e57baf-6386-4bdc-b9fa-ef2025a596a7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:31.007790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e57baf-6386-4bdc-b9fa-ef2025a596a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:31.007982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccced01-b939-4fc0-8a0f-0aa0becdde81 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:31.008083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e57baf-6386-4bdc-b9fa-ef2025a596a7 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:31.008753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e57baf-6386-4bdc-b9fa-ef2025a596a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:31.010640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e57baf-6386-4bdc-b9fa-ef2025a596a7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:31.017116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 510/1005] 10.222.0.15 () {56 vars in 1087 bytes} [Thu May 26 03:05:30 2022] GET /identity/v3/services => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:05:31.046499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07eb6b-8f97-4515-a8da-6135a9ce1fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:31.047194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07eb6b-8f97-4515-a8da-6135a9ce1fac None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:31.047491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07eb6b-8f97-4515-a8da-6135a9ce1fac None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:31.047757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07eb6b-8f97-4515-a8da-6135a9ce1fac None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:31.048517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07eb6b-8f97-4515-a8da-6135a9ce1fac None admin] RBAC: Adding query filter params (name=image) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:31.048830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07eb6b-8f97-4515-a8da-6135a9ce1fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:31.050249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07eb6b-8f97-4515-a8da-6135a9ce1fac None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:31.060656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 496/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:31.061772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e57baf-6386-4bdc-b9fa-ef2025a596a7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:31.126478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:31.175417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e57baf-6386-4bdc-b9fa-ef2025a596a7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:31.214826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c28ca9-5eca-4729-8f62-2d56e091aa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:31.215499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c28ca9-5eca-4729-8f62-2d56e091aa35 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:31.215785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c28ca9-5eca-4729-8f62-2d56e091aa35 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:31.216058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c28ca9-5eca-4729-8f62-2d56e091aa35 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:31.216796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c28ca9-5eca-4729-8f62-2d56e091aa35 None admin] RBAC: Adding query filter params (type=image) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:31.217102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c28ca9-5eca-4729-8f62-2d56e091aa35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:31.218454 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c28ca9-5eca-4729-8f62-2d56e091aa35 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:31.225735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 511/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:32.795255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f1e9-8187-4299-bbf4-77a848ccf0aa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:32.795798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f1e9-8187-4299-bbf4-77a848ccf0aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:32.795798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f1e9-8187-4299-bbf4-77a848ccf0aa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:32.799161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 497/1008] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:32.803080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c1ed9-142a-49eb-8bfd-ce5a9193a993 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:32.803518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c1ed9-142a-49eb-8bfd-ce5a9193a993 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:32.803810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c1ed9-142a-49eb-8bfd-ce5a9193a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:32.820625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-651c1ed9-142a-49eb-8bfd-ce5a9193a993 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:32.822326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-651c1ed9-142a-49eb-8bfd-ce5a9193a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:32.935312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 512/1009] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:32.955086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f1e9-8187-4299-bbf4-77a848ccf0aa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:33.050827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:33.062343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f1e9-8187-4299-bbf4-77a848ccf0aa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:33.097532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ebd0b-db0a-450c-8995-53a3fc8822df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:33.098309 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ebd0b-db0a-450c-8995-53a3fc8822df None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.098587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ebd0b-db0a-450c-8995-53a3fc8822df None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.098859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ebd0b-db0a-450c-8995-53a3fc8822df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.100009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ebd0b-db0a-450c-8995-53a3fc8822df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:33.101466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ebd0b-db0a-450c-8995-53a3fc8822df None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:33.108089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 498/1010] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:33.109290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c1ed9-142a-49eb-8bfd-ce5a9193a993 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:33.160155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:33.209999 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c1ed9-142a-49eb-8bfd-ce5a9193a993 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:33.230727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8d3e-4fd6-4bd1-8dc2-5e62e2e7cf52 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.231080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8d3e-4fd6-4bd1-8dc2-5e62e2e7cf52 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.231289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b8d3e-4fd6-4bd1-8dc2-5e62e2e7cf52 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.232910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 499/1011] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:33.238896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927a66a-949b-4d1e-8830-dc18cce42691 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.239211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927a66a-949b-4d1e-8830-dc18cce42691 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.239462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927a66a-949b-4d1e-8830-dc18cce42691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.251658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a9d2-cb11-4aba-9ff8-4bd969dc492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:33.252365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a9d2-cb11-4aba-9ff8-4bd969dc492b None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.252651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a9d2-cb11-4aba-9ff8-4bd969dc492b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.252922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a9d2-cb11-4aba-9ff8-4bd969dc492b None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.253641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a9d2-cb11-4aba-9ff8-4bd969dc492b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:33.255093 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a9d2-cb11-4aba-9ff8-4bd969dc492b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:33.257119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1927a66a-949b-4d1e-8830-dc18cce42691 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:33.258396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1927a66a-949b-4d1e-8830-dc18cce42691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:33.324797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 500/1012] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:33.340257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 513/1013] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:05:33 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:33.347963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927a66a-949b-4d1e-8830-dc18cce42691 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:33.423836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c7f25-71e3-4492-9b0e-89a7b6381478 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.424131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c7f25-71e3-4492-9b0e-89a7b6381478 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.424448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c7f25-71e3-4492-9b0e-89a7b6381478 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.425863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 514/1014] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:33.431457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd2ccf-5902-4447-8f26-da9e26bf7c90 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.431759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd2ccf-5902-4447-8f26-da9e26bf7c90 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.432012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd2ccf-5902-4447-8f26-da9e26bf7c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.450256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:33.450640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4ddd2ccf-5902-4447-8f26-da9e26bf7c90 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:33.451871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4ddd2ccf-5902-4447-8f26-da9e26bf7c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:33.464790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927a66a-949b-4d1e-8830-dc18cce42691 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:33.505840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233aaba-0310-44bd-8ce5-30fad6ea8261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:33.506934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233aaba-0310-44bd-8ce5-30fad6ea8261 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.507223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233aaba-0310-44bd-8ce5-30fad6ea8261 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.508024 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233aaba-0310-44bd-8ce5-30fad6ea8261 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.508742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233aaba-0310-44bd-8ce5-30fad6ea8261 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:33.511331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233aaba-0310-44bd-8ce5-30fad6ea8261 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1233aaba-0310-44bd-8ce5-30fad6ea8261 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:33.528674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:33.529738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:33.531039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 501/1015] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:33.533423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 515/1016] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:33.535967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233aaba-0310-44bd-8ce5-30fad6ea8261 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:33.556523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd2ccf-5902-4447-8f26-da9e26bf7c90 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:33.590580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:33.645753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233aaba-0310-44bd-8ce5-30fad6ea8261 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:33.663791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd2ccf-5902-4447-8f26-da9e26bf7c90 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:33.687810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572934d1-b0bd-42e5-ba7f-9f456626593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:33.688843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572934d1-b0bd-42e5-ba7f-9f456626593d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.689367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572934d1-b0bd-42e5-ba7f-9f456626593d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.689870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572934d1-b0bd-42e5-ba7f-9f456626593d None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.690755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572934d1-b0bd-42e5-ba7f-9f456626593d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:33.691238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572934d1-b0bd-42e5-ba7f-9f456626593d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:33.692647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572934d1-b0bd-42e5-ba7f-9f456626593d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:33.700565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11019198-d403-4086-9918-61ffaa7c1b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:33.701240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11019198-d403-4086-9918-61ffaa7c1b0b None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.701523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11019198-d403-4086-9918-61ffaa7c1b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.701803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11019198-d403-4086-9918-61ffaa7c1b0b None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.702517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11019198-d403-4086-9918-61ffaa7c1b0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:33.702960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 502/1017] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:33.703950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572934d1-b0bd-42e5-ba7f-9f456626593d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:33.704158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11019198-d403-4086-9918-61ffaa7c1b0b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:33.723372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:33.767784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 516/1018] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:05:33 2022] POST /identity/v3/services => generated 242 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:05:33.820031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572934d1-b0bd-42e5-ba7f-9f456626593d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:33.866584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfab2ad-5767-4531-a4aa-355605a5834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:33.867178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab2ad-5767-4531-a4aa-355605a5834b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:33.867460 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab2ad-5767-4531-a4aa-355605a5834b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:33.867738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab2ad-5767-4531-a4aa-355605a5834b None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:33.869161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab2ad-5767-4531-a4aa-355605a5834b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:33.869471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab2ad-5767-4531-a4aa-355605a5834b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:33.870870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab2ad-5767-4531-a4aa-355605a5834b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:33.881399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 503/1019] 10.222.0.15 () {56 vars in 1112 bytes} [Thu May 26 03:05:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:33.883111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11019198-d403-4086-9918-61ffaa7c1b0b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:33.986071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:33.996356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11019198-d403-4086-9918-61ffaa7c1b0b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:34.030522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73418905-ed4b-4f95-acd0-f586df71cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:34.031179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73418905-ed4b-4f95-acd0-f586df71cbd3 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:34.031457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73418905-ed4b-4f95-acd0-f586df71cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:34.031727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73418905-ed4b-4f95-acd0-f586df71cbd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:34.032493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73418905-ed4b-4f95-acd0-f586df71cbd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:34.033914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73418905-ed4b-4f95-acd0-f586df71cbd3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:34.098376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 517/1020] 10.222.0.15 () {60 vars in 1144 bytes} [Thu May 26 03:05:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:35.609476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e290a2-f244-49b2-a643-aa5e7608520c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:35.609998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e290a2-f244-49b2-a643-aa5e7608520c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:35.610112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e290a2-f244-49b2-a643-aa5e7608520c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:35.611436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 504/1021] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:35.616698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0990-7a99-4e42-a3bf-0249e6484d2e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:35.617076 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0990-7a99-4e42-a3bf-0249e6484d2e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:35.617258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0990-7a99-4e42-a3bf-0249e6484d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:35.634624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-635f0990-7a99-4e42-a3bf-0249e6484d2e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:35.635791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-635f0990-7a99-4e42-a3bf-0249e6484d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:35.710064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 518/1022] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:35.734984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e290a2-f244-49b2-a643-aa5e7608520c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:35.820873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:35.845069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e290a2-f244-49b2-a643-aa5e7608520c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:35.880837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22667ef-c92c-4c26-a7e9-5bad64c9b51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:35.881553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22667ef-c92c-4c26-a7e9-5bad64c9b51d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:35.881836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22667ef-c92c-4c26-a7e9-5bad64c9b51d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:35.882112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22667ef-c92c-4c26-a7e9-5bad64c9b51d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:35.883286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22667ef-c92c-4c26-a7e9-5bad64c9b51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:35.884871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22667ef-c92c-4c26-a7e9-5bad64c9b51d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:35.890997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 505/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:35.892494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0990-7a99-4e42-a3bf-0249e6484d2e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:35.965009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:35.982183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6ef33-1ab0-4efb-8fcd-8d53dba5096d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:35.982492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6ef33-1ab0-4efb-8fcd-8d53dba5096d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:35.982743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6ef33-1ab0-4efb-8fcd-8d53dba5096d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:35.984262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 506/1024] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:35.988906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d383d-b8b5-40cf-a27d-ea4d602b4a23 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:35.989189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d383d-b8b5-40cf-a27d-ea4d602b4a23 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:35.989461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d383d-b8b5-40cf-a27d-ea4d602b4a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:35.996275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0990-7a99-4e42-a3bf-0249e6484d2e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:36.006752 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7a1d383d-b8b5-40cf-a27d-ea4d602b4a23 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:36.008159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7a1d383d-b8b5-40cf-a27d-ea4d602b4a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:36.032107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bb68c-2878-47f8-a423-06edfd094374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:36.032818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb68c-2878-47f8-a423-06edfd094374 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.033141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb68c-2878-47f8-a423-06edfd094374 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.033615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb68c-2878-47f8-a423-06edfd094374 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.034531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bb68c-2878-47f8-a423-06edfd094374 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:36.036418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bb68c-2878-47f8-a423-06edfd094374 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:36.076496 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 507/1025] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:36.099020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d383d-b8b5-40cf-a27d-ea4d602b4a23 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:36.138085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 519/1026] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:05:35 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:05:36.179170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:36.208336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d383d-b8b5-40cf-a27d-ea4d602b4a23 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:36.248175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9eca2-5cc1-4d98-8eac-fc924ac6cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:36.249018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9eca2-5cc1-4d98-8eac-fc924ac6cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.249304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9eca2-5cc1-4d98-8eac-fc924ac6cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.249580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9eca2-5cc1-4d98-8eac-fc924ac6cbc7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.250243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9eca2-5cc1-4d98-8eac-fc924ac6cbc7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:36.251639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9eca2-5cc1-4d98-8eac-fc924ac6cbc7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-27b9eca2-5cc1-4d98-8eac-fc924ac6cbc7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:36.264550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:36.265665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:36.271587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 508/1027] 10.222.0.15 () {56 vars in 1105 bytes} [Thu May 26 03:05:36 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:36.272440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bb68c-2878-47f8-a423-06edfd094374 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:36.381384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bb68c-2878-47f8-a423-06edfd094374 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:36.401853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb920aa0-3bb9-4a70-907a-b4fc661b6ceb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.402031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb920aa0-3bb9-4a70-907a-b4fc661b6ceb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.402301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb920aa0-3bb9-4a70-907a-b4fc661b6ceb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.403678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 509/1028] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:36.409236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c9e5-65d6-47b3-8af2-6e221db31086 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.409516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c9e5-65d6-47b3-8af2-6e221db31086 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.409792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c9e5-65d6-47b3-8af2-6e221db31086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.414030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:36.418369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aadb74-3ffd-4fb0-aba8-660fbe71f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:36.419407 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aadb74-3ffd-4fb0-aba8-660fbe71f2db None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.419683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aadb74-3ffd-4fb0-aba8-660fbe71f2db None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.420020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aadb74-3ffd-4fb0-aba8-660fbe71f2db None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.420798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aadb74-3ffd-4fb0-aba8-660fbe71f2db None admin] RBAC: Adding query filter params (name=image) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:36.421109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aadb74-3ffd-4fb0-aba8-660fbe71f2db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:36.422480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aadb74-3ffd-4fb0-aba8-660fbe71f2db None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:36.427770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 520/1029] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:36.428140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0a31c9e5-65d6-47b3-8af2-6e221db31086 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:36.429444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0a31c9e5-65d6-47b3-8af2-6e221db31086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:36.433947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aadb74-3ffd-4fb0-aba8-660fbe71f2db None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:36.504917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 510/1030] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:36.529347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c9e5-65d6-47b3-8af2-6e221db31086 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:36.551096 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aadb74-3ffd-4fb0-aba8-660fbe71f2db None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:36.589659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c7ca0-6c61-4d0a-8d6a-6e4cf706fa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:36.590333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c7ca0-6c61-4d0a-8d6a-6e4cf706fa26 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.590620 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c7ca0-6c61-4d0a-8d6a-6e4cf706fa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.590898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c7ca0-6c61-4d0a-8d6a-6e4cf706fa26 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.591611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c7ca0-6c61-4d0a-8d6a-6e4cf706fa26 None admin] RBAC: Adding query filter params (type=image) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:36.591913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c7ca0-6c61-4d0a-8d6a-6e4cf706fa26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:36.593338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c7ca0-6c61-4d0a-8d6a-6e4cf706fa26 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:36.598348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 521/1031] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:36.604039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c7ca0-6c61-4d0a-8d6a-6e4cf706fa26 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:36.608625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:36.643097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c9e5-65d6-47b3-8af2-6e221db31086 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:36.661960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:36.681592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9f906-2c76-4773-b709-044ef9d9f601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:36.682408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9f906-2c76-4773-b709-044ef9d9f601 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.682695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9f906-2c76-4773-b709-044ef9d9f601 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.682974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9f906-2c76-4773-b709-044ef9d9f601 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.693203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9f906-2c76-4773-b709-044ef9d9f601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cdd9f906-2c76-4773-b709-044ef9d9f601 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:36.701998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:36.702922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:36.703827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 511/1032] 10.222.0.15 () {56 vars in 1120 bytes} [Thu May 26 03:05:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:36.708939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9f906-2c76-4773-b709-044ef9d9f601 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:36.710770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c7ca0-6c61-4d0a-8d6a-6e4cf706fa26 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:36.746286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34696232-922b-4c29-87da-e606ec10139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:36.747326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34696232-922b-4c29-87da-e606ec10139b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.747812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34696232-922b-4c29-87da-e606ec10139b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.748346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34696232-922b-4c29-87da-e606ec10139b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.749345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34696232-922b-4c29-87da-e606ec10139b None admin] RBAC: Adding query filter params (interface=public, service_id=40889cd337b34e478ffd3361e0360393, region_id=RegionOne) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:36.749871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34696232-922b-4c29-87da-e606ec10139b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:36.751368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34696232-922b-4c29-87da-e606ec10139b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:36.757074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 522/1033] 10.222.0.15 () {56 vars in 1251 bytes} [Thu May 26 03:05:36 2022] GET /identity/v3/endpoints?service_id=40889cd337b34e478ffd3361e0360393&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:36.762973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34696232-922b-4c29-87da-e606ec10139b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:36.820649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9f906-2c76-4773-b709-044ef9d9f601 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:36.849861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:36.858380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4a2ab-81aa-4139-8e40-6a90f83ad3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:36.859050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4a2ab-81aa-4139-8e40-6a90f83ad3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.859334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4a2ab-81aa-4139-8e40-6a90f83ad3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.859611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4a2ab-81aa-4139-8e40-6a90f83ad3e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.860389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4a2ab-81aa-4139-8e40-6a90f83ad3e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:36.860814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4a2ab-81aa-4139-8e40-6a90f83ad3e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:36.862305 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4a2ab-81aa-4139-8e40-6a90f83ad3e7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:36.870398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34696232-922b-4c29-87da-e606ec10139b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:36.875934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 512/1034] 10.222.0.15 () {56 vars in 1115 bytes} [Thu May 26 03:05:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:36.876893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4a2ab-81aa-4139-8e40-6a90f83ad3e7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:36.896685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:36.912574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803676-daf4-45db-a29e-97788ad43bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:36.914341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803676-daf4-45db-a29e-97788ad43bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:36.914838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803676-daf4-45db-a29e-97788ad43bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:36.915367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803676-daf4-45db-a29e-97788ad43bf9 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:36.916262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87803676-daf4-45db-a29e-97788ad43bf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:36.918175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87803676-daf4-45db-a29e-97788ad43bf9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:36.926919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 523/1035] 10.222.0.15 () {56 vars in 1087 bytes} [Thu May 26 03:05:36 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:05:36.986852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4a2ab-81aa-4139-8e40-6a90f83ad3e7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:37.025699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7ff30-5957-41fe-a451-e2dd6d4505b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:37.026780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7ff30-5957-41fe-a451-e2dd6d4505b2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:37.027215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7ff30-5957-41fe-a451-e2dd6d4505b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:37.027641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7ff30-5957-41fe-a451-e2dd6d4505b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:37.039856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7ff30-5957-41fe-a451-e2dd6d4505b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:37.042180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7ff30-5957-41fe-a451-e2dd6d4505b2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-83b7ff30-5957-41fe-a451-e2dd6d4505b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:37.061457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:37.062500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:37.067973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:37.067973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:37.067973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:37.067973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:37.067973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 513/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:37.070175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803676-daf4-45db-a29e-97788ad43bf9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:37.175650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803676-daf4-45db-a29e-97788ad43bf9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:37.209373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fc00b-e110-456c-9cfd-3add41a97ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:37.210557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc00b-e110-456c-9cfd-3add41a97ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:37.211023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc00b-e110-456c-9cfd-3add41a97ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:37.211498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fc00b-e110-456c-9cfd-3add41a97ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:37.212444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fc00b-e110-456c-9cfd-3add41a97ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:37.212934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fc00b-e110-456c-9cfd-3add41a97ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:37.214482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fc00b-e110-456c-9cfd-3add41a97ad2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:37.227351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 524/1037] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:37.233574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7ff30-5957-41fe-a451-e2dd6d4505b2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:37.278261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:37.338096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7ff30-5957-41fe-a451-e2dd6d4505b2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:37.374057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4740736-98e0-422c-8d29-780afa3910aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:37.374852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4740736-98e0-422c-8d29-780afa3910aa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:37.375138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4740736-98e0-422c-8d29-780afa3910aa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:37.375419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4740736-98e0-422c-8d29-780afa3910aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:37.383308 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4740736-98e0-422c-8d29-780afa3910aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:37.384838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4740736-98e0-422c-8d29-780afa3910aa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a4740736-98e0-422c-8d29-780afa3910aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:37.398946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:37.400504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:37.401478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 514/1038] 10.222.0.15 () {56 vars in 1093 bytes} [Thu May 26 03:05:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:37.408236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fc00b-e110-456c-9cfd-3add41a97ad2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:37.457923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:37.512767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fc00b-e110-456c-9cfd-3add41a97ad2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:37.546494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1abb34-dad3-49d6-8743-afce2fa8f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:37.547164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1abb34-dad3-49d6-8743-afce2fa8f212 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:37.547448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1abb34-dad3-49d6-8743-afce2fa8f212 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:37.547724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1abb34-dad3-49d6-8743-afce2fa8f212 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:37.548573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1abb34-dad3-49d6-8743-afce2fa8f212 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:37.548889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1abb34-dad3-49d6-8743-afce2fa8f212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:37.550296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1abb34-dad3-49d6-8743-afce2fa8f212 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:37.571607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 525/1039] 10.222.0.15 () {56 vars in 1133 bytes} [Thu May 26 03:05:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:37.573250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4740736-98e0-422c-8d29-780afa3910aa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:37.673611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4740736-98e0-422c-8d29-780afa3910aa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:37.675154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:37.707458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a408fc9-77b9-43df-bd66-816f3b6c55f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:37.708163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a408fc9-77b9-43df-bd66-816f3b6c55f4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:37.708437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a408fc9-77b9-43df-bd66-816f3b6c55f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:37.708720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a408fc9-77b9-43df-bd66-816f3b6c55f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:37.777901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a408fc9-77b9-43df-bd66-816f3b6c55f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:37.779376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a408fc9-77b9-43df-bd66-816f3b6c55f4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:37.888264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 515/1040] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 03:05:37.889799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1abb34-dad3-49d6-8743-afce2fa8f212 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:37.991675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1abb34-dad3-49d6-8743-afce2fa8f212 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:37.993176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:38.027053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d6314-3997-4a2f-9093-aec421af87d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:38.027880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d6314-3997-4a2f-9093-aec421af87d1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:38.028205 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d6314-3997-4a2f-9093-aec421af87d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:38.028482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d6314-3997-4a2f-9093-aec421af87d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:38.040784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d6314-3997-4a2f-9093-aec421af87d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:38.042245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d6314-3997-4a2f-9093-aec421af87d1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-7a4d6314-3997-4a2f-9093-aec421af87d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:38.060487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:38.061395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:38.062314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:38.062314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:38.062314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:38.062314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:38.062314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 526/1041] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:38.068273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a408fc9-77b9-43df-bd66-816f3b6c55f4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:38.070474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:38.170928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a408fc9-77b9-43df-bd66-816f3b6c55f4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:38.205765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0794e-2b74-43e9-8b4b-a38a8ccd10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:38.206428 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0794e-2b74-43e9-8b4b-a38a8ccd10f8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:38.206713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0794e-2b74-43e9-8b4b-a38a8ccd10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:38.206991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0794e-2b74-43e9-8b4b-a38a8ccd10f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:38.207713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0794e-2b74-43e9-8b4b-a38a8ccd10f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:38.208021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0794e-2b74-43e9-8b4b-a38a8ccd10f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:38.209425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0794e-2b74-43e9-8b4b-a38a8ccd10f8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:38.226042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 516/1042] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:38.227859 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d6314-3997-4a2f-9093-aec421af87d1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:38.329649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d6314-3997-4a2f-9093-aec421af87d1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:38.362690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ef494-382f-4bb5-a102-4a54e472331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:38.363481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef494-382f-4bb5-a102-4a54e472331e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:38.363766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef494-382f-4bb5-a102-4a54e472331e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:38.364040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef494-382f-4bb5-a102-4a54e472331e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:38.371202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ef494-382f-4bb5-a102-4a54e472331e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:38.372658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ef494-382f-4bb5-a102-4a54e472331e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-080ef494-382f-4bb5-a102-4a54e472331e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:38.386821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:38.387711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:38.393293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:38.393293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:38.393293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:38.393293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:38.393293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:38.393293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:38.393293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:38.393293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:38.393293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 527/1043] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:38.395670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0794e-2b74-43e9-8b4b-a38a8ccd10f8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:38.416763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a843-b31c-4b9b-a5b3-0a1c4a6fb146 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:38.417062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a843-b31c-4b9b-a5b3-0a1c4a6fb146 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:38.417319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a843-b31c-4b9b-a5b3-0a1c4a6fb146 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:38.418885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 528/1044] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:38.423596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52215edf-cf17-451d-8840-10ef0790f1be None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:38.423884 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52215edf-cf17-451d-8840-10ef0790f1be None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:38.424158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52215edf-cf17-451d-8840-10ef0790f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:38.441687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-52215edf-cf17-451d-8840-10ef0790f1be None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:38.442878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-52215edf-cf17-451d-8840-10ef0790f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:38.453231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:38.460669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:38.499336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0794e-2b74-43e9-8b4b-a38a8ccd10f8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:38.512356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 529/1045] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:38.532693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c73b61-8c72-4491-85cb-085681f800fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:38.533354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c73b61-8c72-4491-85cb-085681f800fe None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:38.533634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c73b61-8c72-4491-85cb-085681f800fe None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:38.533908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c73b61-8c72-4491-85cb-085681f800fe None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:38.534697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c73b61-8c72-4491-85cb-085681f800fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:38.535038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c73b61-8c72-4491-85cb-085681f800fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:38.535396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52215edf-cf17-451d-8840-10ef0790f1be None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:38.536537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c73b61-8c72-4491-85cb-085681f800fe None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:38.550667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 517/1046] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:38.557436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c73b61-8c72-4491-85cb-085681f800fe None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:38.645522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52215edf-cf17-451d-8840-10ef0790f1be None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:38.658334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c73b61-8c72-4491-85cb-085681f800fe None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:38.683455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:38.685234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1f6c-1a39-415e-b695-79f12073322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:38.686028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1f6c-1a39-415e-b695-79f12073322b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:38.686308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1f6c-1a39-415e-b695-79f12073322b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:38.686581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1f6c-1a39-415e-b695-79f12073322b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:38.696041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551382b-e95f-4da2-8ecc-7892b2cfb14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:38.698276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551382b-e95f-4da2-8ecc-7892b2cfb14a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:38.698276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551382b-e95f-4da2-8ecc-7892b2cfb14a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:38.698276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551382b-e95f-4da2-8ecc-7892b2cfb14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:38.698513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d1f6c-1a39-415e-b695-79f12073322b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:38.698598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551382b-e95f-4da2-8ecc-7892b2cfb14a None admin] RBAC: Adding query filter params (role.id=d37e7ae615d44a709c874db9d5fa0d2f, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=51f966be1d764324b7695e1caf578291) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:38.698598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551382b-e95f-4da2-8ecc-7892b2cfb14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:38.699795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551382b-e95f-4da2-8ecc-7892b2cfb14a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c00d1f6c-1a39-415e-b695-79f12073322b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:38.705191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:38.706145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:38.712920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 530/1047] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:05:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:38.713673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 518/1048] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:38 2022] GET /identity/v3/role_assignments?user.id=51f966be1d764324b7695e1caf578291&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=d37e7ae615d44a709c874db9d5fa0d2f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:38.713757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1f6c-1a39-415e-b695-79f12073322b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:38.718464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:38.832037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1f6c-1a39-415e-b695-79f12073322b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:38.871180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98798f17-c031-4436-9c3f-5c1c4fd95325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:38.871946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98798f17-c031-4436-9c3f-5c1c4fd95325 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:38.872230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98798f17-c031-4436-9c3f-5c1c4fd95325 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:38.872532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98798f17-c031-4436-9c3f-5c1c4fd95325 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:38.873337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98798f17-c031-4436-9c3f-5c1c4fd95325 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:38.873646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98798f17-c031-4436-9c3f-5c1c4fd95325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:38.875042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98798f17-c031-4436-9c3f-5c1c4fd95325 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:38.886344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 531/1049] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:38.892249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551382b-e95f-4da2-8ecc-7892b2cfb14a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:38.998098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551382b-e95f-4da2-8ecc-7892b2cfb14a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:39.031448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c20cc-d09c-4475-9b84-639f14b88226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:39.032347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c20cc-d09c-4475-9b84-639f14b88226 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.032638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c20cc-d09c-4475-9b84-639f14b88226 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.032914 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c20cc-d09c-4475-9b84-639f14b88226 None admin] PATH_INFO: `/v3/users/7b1137577f2f46ff99ca3f831481c5de` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.047027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c20cc-d09c-4475-9b84-639f14b88226 None admin] RBAC: Authorizing `identity:get_user(user_id=7b1137577f2f46ff99ca3f831481c5de)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:39.048503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c20cc-d09c-4475-9b84-639f14b88226 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:39.050191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 519/1050] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:05:38 2022] GET /identity/v3/users/7b1137577f2f46ff99ca3f831481c5de => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:39.055968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98798f17-c031-4436-9c3f-5c1c4fd95325 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:39.121864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:39.134512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1071-c8b3-462a-8eef-d1dfdd6c4e85 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.134796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1071-c8b3-462a-8eef-d1dfdd6c4e85 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.139164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1071-c8b3-462a-8eef-d1dfdd6c4e85 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.139164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 520/1051] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:39.141427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bedae7-f925-4b32-b9bb-b7ef44f20e8f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.141719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bedae7-f925-4b32-b9bb-b7ef44f20e8f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.142001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bedae7-f925-4b32-b9bb-b7ef44f20e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.156756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98798f17-c031-4436-9c3f-5c1c4fd95325 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:39.158979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a0bedae7-f925-4b32-b9bb-b7ef44f20e8f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:39.160159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a0bedae7-f925-4b32-b9bb-b7ef44f20e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:39.191718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf5921-7e01-4a8c-a9da-4c301761e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:39.192394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf5921-7e01-4a8c-a9da-4c301761e497 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.192676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf5921-7e01-4a8c-a9da-4c301761e497 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.192960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf5921-7e01-4a8c-a9da-4c301761e497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.202732 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:39.231501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 521/1052] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:39.254984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bedae7-f925-4b32-b9bb-b7ef44f20e8f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:39.268625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf5921-7e01-4a8c-a9da-4c301761e497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:39.270065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf5921-7e01-4a8c-a9da-4c301761e497 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:39.340884 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:39.358454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bedae7-f925-4b32-b9bb-b7ef44f20e8f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:39.384700 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 532/1053] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:05:39.385873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf5921-7e01-4a8c-a9da-4c301761e497 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:39.393889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccbcbb-6c01-44ce-b148-71b01d6b5f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:39.394685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccbcbb-6c01-44ce-b148-71b01d6b5f16 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.394972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccbcbb-6c01-44ce-b148-71b01d6b5f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.395249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccbcbb-6c01-44ce-b148-71b01d6b5f16 None admin] PATH_INFO: `/v3/services/image` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.395904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccbcbb-6c01-44ce-b148-71b01d6b5f16 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:39.397326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccbcbb-6c01-44ce-b148-71b01d6b5f16 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d9ccbcbb-6c01-44ce-b148-71b01d6b5f16 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:39.409722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:39.410743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:39.411669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 522/1054] 10.222.0.15 () {56 vars in 1105 bytes} [Thu May 26 03:05:39 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:39.416757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccbcbb-6c01-44ce-b148-71b01d6b5f16 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:39.457448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:39.496144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf5921-7e01-4a8c-a9da-4c301761e497 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:39.521132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccbcbb-6c01-44ce-b148-71b01d6b5f16 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:39.532140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126ffe2-c037-407a-b4a5-dc2ca97e47ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:39.533094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126ffe2-c037-407a-b4a5-dc2ca97e47ce None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.533374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126ffe2-c037-407a-b4a5-dc2ca97e47ce None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.533645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126ffe2-c037-407a-b4a5-dc2ca97e47ce None admin] PATH_INFO: `/v3/projects/2830b8086f8a49ffb945672c63d68aa9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.534817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126ffe2-c037-407a-b4a5-dc2ca97e47ce None admin] RBAC: Authorizing `identity:get_project(project_id=2830b8086f8a49ffb945672c63d68aa9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:39.536235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126ffe2-c037-407a-b4a5-dc2ca97e47ce None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:39.542899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 533/1055] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:05:39 2022] GET /identity/v3/projects/2830b8086f8a49ffb945672c63d68aa9 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:39.543748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126ffe2-c037-407a-b4a5-dc2ca97e47ce None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:39.562289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d36b9f-a2c6-43b8-8499-30667e08ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:39.563239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d36b9f-a2c6-43b8-8499-30667e08ec7f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.563362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d36b9f-a2c6-43b8-8499-30667e08ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.563607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d36b9f-a2c6-43b8-8499-30667e08ec7f None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.564341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d36b9f-a2c6-43b8-8499-30667e08ec7f None admin] RBAC: Adding query filter params (name=image) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:39.564661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d36b9f-a2c6-43b8-8499-30667e08ec7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:39.566031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d36b9f-a2c6-43b8-8499-30667e08ec7f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:39.575776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 523/1056] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:39.577006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d36b9f-a2c6-43b8-8499-30667e08ec7f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:39.581430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:39.649212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126ffe2-c037-407a-b4a5-dc2ca97e47ce None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:39.679368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d36b9f-a2c6-43b8-8499-30667e08ec7f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:39.682217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:39.686035 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca66af-fe85-455e-a3ff-57737392ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:39.686690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca66af-fe85-455e-a3ff-57737392ef1c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.687226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca66af-fe85-455e-a3ff-57737392ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.687226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca66af-fe85-455e-a3ff-57737392ef1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.688046 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca66af-fe85-455e-a3ff-57737392ef1c None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=2830b8086f8a49ffb945672c63d68aa9, user.id=7b1137577f2f46ff99ca3f831481c5de) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:39.688418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca66af-fe85-455e-a3ff-57737392ef1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:39.689880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca66af-fe85-455e-a3ff-57737392ef1c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:39.700572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 534/1057] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:39 2022] GET /identity/v3/role_assignments?user.id=7b1137577f2f46ff99ca3f831481c5de&scope.project.id=2830b8086f8a49ffb945672c63d68aa9&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:39.720455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977821cc-f4fe-4860-ab16-9e78cb527966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:39.721563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977821cc-f4fe-4860-ab16-9e78cb527966 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.721906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977821cc-f4fe-4860-ab16-9e78cb527966 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.722256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977821cc-f4fe-4860-ab16-9e78cb527966 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.723118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977821cc-f4fe-4860-ab16-9e78cb527966 None admin] RBAC: Adding query filter params (type=image) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:39.723496 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977821cc-f4fe-4860-ab16-9e78cb527966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:39.725080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977821cc-f4fe-4860-ab16-9e78cb527966 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:39.737235 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 524/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:39.738599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca66af-fe85-455e-a3ff-57737392ef1c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:39.854106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:39.858248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca66af-fe85-455e-a3ff-57737392ef1c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:39.895453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a6b74-eeac-42c2-80a9-5ad1678afa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:39.896125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a6b74-eeac-42c2-80a9-5ad1678afa2f None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:39.896441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a6b74-eeac-42c2-80a9-5ad1678afa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:39.896733 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a6b74-eeac-42c2-80a9-5ad1678afa2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:39.897465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a6b74-eeac-42c2-80a9-5ad1678afa2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:39.898824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a6b74-eeac-42c2-80a9-5ad1678afa2f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:40.020350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 535/1059] 10.222.0.15 () {60 vars in 1144 bytes} [Thu May 26 03:05:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:40.923741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80438784-b892-440b-9e63-fe32dab6d572 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:40.924277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80438784-b892-440b-9e63-fe32dab6d572 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:40.924277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80438784-b892-440b-9e63-fe32dab6d572 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:40.925773 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 525/1060] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:40.931097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea97dff-2a60-4388-9d97-28a347018d15 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:40.931530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea97dff-2a60-4388-9d97-28a347018d15 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:40.931673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea97dff-2a60-4388-9d97-28a347018d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:40.949013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bea97dff-2a60-4388-9d97-28a347018d15 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:40.950178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bea97dff-2a60-4388-9d97-28a347018d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:41.032358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 536/1061] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:41.049651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80438784-b892-440b-9e63-fe32dab6d572 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:41.154841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80438784-b892-440b-9e63-fe32dab6d572 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:41.189367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff4d89-f5ef-4693-81dd-695a38d2b20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:41.190181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff4d89-f5ef-4693-81dd-695a38d2b20f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:41.190464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff4d89-f5ef-4693-81dd-695a38d2b20f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:41.190740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff4d89-f5ef-4693-81dd-695a38d2b20f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:41.201824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff4d89-f5ef-4693-81dd-695a38d2b20f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1eff4d89-f5ef-4693-81dd-695a38d2b20f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:41.210332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:41.211283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:41.212201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:41.216510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 526/1062] 10.222.0.15 () {56 vars in 1120 bytes} [Thu May 26 03:05:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:41.217528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea97dff-2a60-4388-9d97-28a347018d15 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:41.299333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:41.318332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea97dff-2a60-4388-9d97-28a347018d15 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:41.352255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14f85b-c01c-4c07-aa2e-2ce11130ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:41.352980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14f85b-c01c-4c07-aa2e-2ce11130ec1b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:41.353266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14f85b-c01c-4c07-aa2e-2ce11130ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:41.353544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14f85b-c01c-4c07-aa2e-2ce11130ec1b None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:41.354287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14f85b-c01c-4c07-aa2e-2ce11130ec1b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:41.354596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14f85b-c01c-4c07-aa2e-2ce11130ec1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:41.355951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14f85b-c01c-4c07-aa2e-2ce11130ec1b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:41.368549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 537/1063] 10.222.0.15 () {56 vars in 1115 bytes} [Thu May 26 03:05:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:41.371001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff4d89-f5ef-4693-81dd-695a38d2b20f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:41.399125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:41.471012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff4d89-f5ef-4693-81dd-695a38d2b20f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:41.505063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd1c1-bf5d-4acd-8398-be2ca8ce9d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:41.505872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd1c1-bf5d-4acd-8398-be2ca8ce9d4c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:41.506154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd1c1-bf5d-4acd-8398-be2ca8ce9d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:41.506429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd1c1-bf5d-4acd-8398-be2ca8ce9d4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:41.516933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd1c1-bf5d-4acd-8398-be2ca8ce9d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:41.518390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd1c1-bf5d-4acd-8398-be2ca8ce9d4c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-db5cd1c1-bf5d-4acd-8398-be2ca8ce9d4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:41.535815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:41.536952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:41.537886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:41.537886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:41.537886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:41.537886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:41.542501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 527/1064] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:41.543728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14f85b-c01c-4c07-aa2e-2ce11130ec1b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:41.644164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14f85b-c01c-4c07-aa2e-2ce11130ec1b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:41.677464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86d39-e7c1-41f3-9f76-764d7b10174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:41.678349 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86d39-e7c1-41f3-9f76-764d7b10174d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:41.678781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86d39-e7c1-41f3-9f76-764d7b10174d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:41.679230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86d39-e7c1-41f3-9f76-764d7b10174d None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:41.680087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86d39-e7c1-41f3-9f76-764d7b10174d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:41.681124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86d39-e7c1-41f3-9f76-764d7b10174d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:41.682626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86d39-e7c1-41f3-9f76-764d7b10174d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:41.695000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 538/1065] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:41.700852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd1c1-bf5d-4acd-8398-be2ca8ce9d4c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:41.782016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:41.810883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd1c1-bf5d-4acd-8398-be2ca8ce9d4c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:41.845893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c5e45-e7dd-4c46-b4b8-f0671342e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:41.846695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5e45-e7dd-4c46-b4b8-f0671342e817 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:41.846976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5e45-e7dd-4c46-b4b8-f0671342e817 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:41.847250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5e45-e7dd-4c46-b4b8-f0671342e817 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:41.855669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5e45-e7dd-4c46-b4b8-f0671342e817 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:41.857223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5e45-e7dd-4c46-b4b8-f0671342e817 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-8f9c5e45-e7dd-4c46-b4b8-f0671342e817 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:41.872329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:41.873313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:41.878864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 528/1066] 10.222.0.15 () {56 vars in 1093 bytes} [Thu May 26 03:05:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:41.879493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86d39-e7c1-41f3-9f76-764d7b10174d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:41.882069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:41.893993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758ba2-353d-4850-9bcd-988bd38554df None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:41.894285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758ba2-353d-4850-9bcd-988bd38554df None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:41.894566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758ba2-353d-4850-9bcd-988bd38554df None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:41.896070 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 529/1067] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:05:41.901383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ac140-4f16-4853-b100-4d6227b2e7a7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:41.901673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ac140-4f16-4853-b100-4d6227b2e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:41.901947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ac140-4f16-4853-b100-4d6227b2e7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:41.919059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-514ac140-4f16-4853-b100-4d6227b2e7a7 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:41.920250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-514ac140-4f16-4853-b100-4d6227b2e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:41.987493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 530/1068] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:41.998092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86d39-e7c1-41f3-9f76-764d7b10174d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.009647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ac140-4f16-4853-b100-4d6227b2e7a7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.035906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7417b-f471-4cfb-b9dc-fa6a94598117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.036960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7417b-f471-4cfb-b9dc-fa6a94598117 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.037439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7417b-f471-4cfb-b9dc-fa6a94598117 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.037717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7417b-f471-4cfb-b9dc-fa6a94598117 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.038585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7417b-f471-4cfb-b9dc-fa6a94598117 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:42.038886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7417b-f471-4cfb-b9dc-fa6a94598117 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.040980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7417b-f471-4cfb-b9dc-fa6a94598117 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:42.068801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 539/1069] 10.222.0.15 () {56 vars in 1133 bytes} [Thu May 26 03:05:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:42.069957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7417b-f471-4cfb-b9dc-fa6a94598117 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.090656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:42.124582 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ac140-4f16-4853-b100-4d6227b2e7a7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.137419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:42.159565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5cf2b-c2ec-466a-9556-b615f2bbd649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.160400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5cf2b-c2ec-466a-9556-b615f2bbd649 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.160681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5cf2b-c2ec-466a-9556-b615f2bbd649 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.160956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5cf2b-c2ec-466a-9556-b615f2bbd649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.171841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5cf2b-c2ec-466a-9556-b615f2bbd649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e1f5cf2b-c2ec-466a-9556-b615f2bbd649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:42.179468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:42.180437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:42.181364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 531/1070] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:42.184733 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7417b-f471-4cfb-b9dc-fa6a94598117 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.186625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5cf2b-c2ec-466a-9556-b615f2bbd649 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.220263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b00f5-bafb-46fe-ac49-bb7df535fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.221074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b00f5-bafb-46fe-ac49-bb7df535fb29 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.221355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b00f5-bafb-46fe-ac49-bb7df535fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.221628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b00f5-bafb-46fe-ac49-bb7df535fb29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.232874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b00f5-bafb-46fe-ac49-bb7df535fb29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.234342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b00f5-bafb-46fe-ac49-bb7df535fb29 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6e4b00f5-bafb-46fe-ac49-bb7df535fb29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:42.251020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:42.251994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:42.252979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:42.252979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:42.252979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:42.252979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:42.252979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 540/1071] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:42.253707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620256-14f5-423b-b934-8dca37f0ee33 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.253986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620256-14f5-423b-b934-8dca37f0ee33 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.254263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620256-14f5-423b-b934-8dca37f0ee33 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.255502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 541/1072] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:42.257607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620256-14f5-423b-b934-8dca37f0ee33 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.291142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5cf2b-c2ec-466a-9556-b615f2bbd649 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.315473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:42.323570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c821044-f8c8-42fc-a4aa-aab784a8f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.326469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c821044-f8c8-42fc-a4aa-aab784a8f093 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.326469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c821044-f8c8-42fc-a4aa-aab784a8f093 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.326469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c821044-f8c8-42fc-a4aa-aab784a8f093 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.326469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c821044-f8c8-42fc-a4aa-aab784a8f093 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:42.326469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c821044-f8c8-42fc-a4aa-aab784a8f093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.327233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c821044-f8c8-42fc-a4aa-aab784a8f093 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:42.336011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 532/1073] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:42.337793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f48b8-6f16-42b4-8717-9a53ef3dd148 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.338076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f48b8-6f16-42b4-8717-9a53ef3dd148 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.338350 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f48b8-6f16-42b4-8717-9a53ef3dd148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.354025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1d1f48b8-6f16-42b4-8717-9a53ef3dd148 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:42.355204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d1f48b8-6f16-42b4-8717-9a53ef3dd148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:42.360916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620256-14f5-423b-b934-8dca37f0ee33 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.373650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:42.394869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0b06-cff2-40a5-aff9-2f2d8ccd9bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.395534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0b06-cff2-40a5-aff9-2f2d8ccd9bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.395818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0b06-cff2-40a5-aff9-2f2d8ccd9bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.396095 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0b06-cff2-40a5-aff9-2f2d8ccd9bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.396836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0b06-cff2-40a5-aff9-2f2d8ccd9bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:42.397156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0b06-cff2-40a5-aff9-2f2d8ccd9bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.398520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0b06-cff2-40a5-aff9-2f2d8ccd9bf0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:42.410845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 542/1074] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:42.411626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0b06-cff2-40a5-aff9-2f2d8ccd9bf0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.425558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 533/1075] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:42.426390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f48b8-6f16-42b4-8717-9a53ef3dd148 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.512630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0b06-cff2-40a5-aff9-2f2d8ccd9bf0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.522223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f48b8-6f16-42b4-8717-9a53ef3dd148 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.542706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:42.546094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082c226-74a9-4334-8775-626b668cba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.546954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082c226-74a9-4334-8775-626b668cba19 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.547236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082c226-74a9-4334-8775-626b668cba19 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.547506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082c226-74a9-4334-8775-626b668cba19 None admin] PATH_INFO: `/v3/users/7b1137577f2f46ff99ca3f831481c5de` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.548702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082c226-74a9-4334-8775-626b668cba19 None admin] RBAC: Authorizing `identity:get_user(user_id=7b1137577f2f46ff99ca3f831481c5de)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.550116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082c226-74a9-4334-8775-626b668cba19 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:42.558443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 543/1076] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/users/7b1137577f2f46ff99ca3f831481c5de => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:42.558443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082c226-74a9-4334-8775-626b668cba19 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.560676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055e1af-7b14-44bf-8d58-cc8a5ea463f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.561885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055e1af-7b14-44bf-8d58-cc8a5ea463f9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.562170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055e1af-7b14-44bf-8d58-cc8a5ea463f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.562456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055e1af-7b14-44bf-8d58-cc8a5ea463f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.569692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055e1af-7b14-44bf-8d58-cc8a5ea463f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.571615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055e1af-7b14-44bf-8d58-cc8a5ea463f9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5055e1af-7b14-44bf-8d58-cc8a5ea463f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:42.585864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:42.587462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 534/1077] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:42.588598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055e1af-7b14-44bf-8d58-cc8a5ea463f9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.596414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:42.653159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082c226-74a9-4334-8775-626b668cba19 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.685165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055e1af-7b14-44bf-8d58-cc8a5ea463f9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.685546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fa2ab-30ac-4d7f-89c5-5f266d182c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.686187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fa2ab-30ac-4d7f-89c5-5f266d182c17 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.686473 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fa2ab-30ac-4d7f-89c5-5f266d182c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.686746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fa2ab-30ac-4d7f-89c5-5f266d182c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.718789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c13c5-8003-4119-847b-80e0268b92f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.719625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c13c5-8003-4119-847b-80e0268b92f2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.719903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c13c5-8003-4119-847b-80e0268b92f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.720181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c13c5-8003-4119-847b-80e0268b92f2 None admin] PATH_INFO: `/v3/projects/2830b8086f8a49ffb945672c63d68aa9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.721364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c13c5-8003-4119-847b-80e0268b92f2 None admin] RBAC: Authorizing `identity:get_project(project_id=2830b8086f8a49ffb945672c63d68aa9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.722787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c13c5-8003-4119-847b-80e0268b92f2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:42.724474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 535/1078] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/projects/2830b8086f8a49ffb945672c63d68aa9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:42.725221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c13c5-8003-4119-847b-80e0268b92f2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.752747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fa2ab-30ac-4d7f-89c5-5f266d182c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.754197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fa2ab-30ac-4d7f-89c5-5f266d182c17 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:42.774316 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:42.798885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:42.827232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c13c5-8003-4119-847b-80e0268b92f2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.857172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 544/1079] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:05:42.857978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fa2ab-30ac-4d7f-89c5-5f266d182c17 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.861639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22058db0-ad3f-445c-8bb7-b3e3421ec186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.862448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22058db0-ad3f-445c-8bb7-b3e3421ec186 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.862735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22058db0-ad3f-445c-8bb7-b3e3421ec186 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.863010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22058db0-ad3f-445c-8bb7-b3e3421ec186 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.863787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22058db0-ad3f-445c-8bb7-b3e3421ec186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:42.864095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22058db0-ad3f-445c-8bb7-b3e3421ec186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.865565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22058db0-ad3f-445c-8bb7-b3e3421ec186 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:42.878134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 536/1080] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:42.878923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22058db0-ad3f-445c-8bb7-b3e3421ec186 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:42.954595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fa2ab-30ac-4d7f-89c5-5f266d182c17 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.976395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22058db0-ad3f-445c-8bb7-b3e3421ec186 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:42.985269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:42.987405 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecd6fd-f104-40f4-ac08-89a2aa59c0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:42.988273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecd6fd-f104-40f4-ac08-89a2aa59c0f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:42.988584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecd6fd-f104-40f4-ac08-89a2aa59c0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:42.988854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecd6fd-f104-40f4-ac08-89a2aa59c0f4 None admin] PATH_INFO: `/v3/projects/2830b8086f8a49ffb945672c63d68aa9/users/7b1137577f2f46ff99ca3f831481c5de/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:42.990747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecd6fd-f104-40f4-ac08-89a2aa59c0f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2830b8086f8a49ffb945672c63d68aa9, user_id=7b1137577f2f46ff99ca3f831481c5de, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:42.992208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecd6fd-f104-40f4-ac08-89a2aa59c0f4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:43.010017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852e3eb-ad93-4fff-8d4d-9187f9bc9669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:43.010793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852e3eb-ad93-4fff-8d4d-9187f9bc9669 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:43.011072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852e3eb-ad93-4fff-8d4d-9187f9bc9669 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:43.011351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852e3eb-ad93-4fff-8d4d-9187f9bc9669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:43.021436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852e3eb-ad93-4fff-8d4d-9187f9bc9669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:43.022966 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852e3eb-ad93-4fff-8d4d-9187f9bc9669 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5852e3eb-ad93-4fff-8d4d-9187f9bc9669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:43.040609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:43.041640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:43.042565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:43.042565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:43.042565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:43.042565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:43.042565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 537/1081] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:43.042864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852e3eb-ad93-4fff-8d4d-9187f9bc9669 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:43.052665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:43.057986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 545/1082] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:05:42 2022] PUT /identity/v3/projects/2830b8086f8a49ffb945672c63d68aa9/users/7b1137577f2f46ff99ca3f831481c5de/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:05:43.058815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecd6fd-f104-40f4-ac08-89a2aa59c0f4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:43.157191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852e3eb-ad93-4fff-8d4d-9187f9bc9669 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:43.173117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecd6fd-f104-40f4-ac08-89a2aa59c0f4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:43.196089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97b01e-fc94-4d36-96cd-01987f6c5bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:43.197039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97b01e-fc94-4d36-96cd-01987f6c5bd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:43.197323 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97b01e-fc94-4d36-96cd-01987f6c5bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:43.197596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97b01e-fc94-4d36-96cd-01987f6c5bd9 None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/51f966be1d764324b7695e1caf578291/roles/d37e7ae615d44a709c874db9d5fa0d2f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:43.199972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97b01e-fc94-4d36-96cd-01987f6c5bd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=51f966be1d764324b7695e1caf578291, role_id=d37e7ae615d44a709c874db9d5fa0d2f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:43.201485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97b01e-fc94-4d36-96cd-01987f6c5bd9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:43.211128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5873bfd-c13e-43d9-a87b-053bc86ef538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:43.211844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5873bfd-c13e-43d9-a87b-053bc86ef538 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:43.212125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5873bfd-c13e-43d9-a87b-053bc86ef538 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:43.212499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5873bfd-c13e-43d9-a87b-053bc86ef538 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:43.213234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5873bfd-c13e-43d9-a87b-053bc86ef538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:43.213541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5873bfd-c13e-43d9-a87b-053bc86ef538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:43.214906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5873bfd-c13e-43d9-a87b-053bc86ef538 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:43.228333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 546/1083] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:43.261951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 538/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:05:43 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/51f966be1d764324b7695e1caf578291/roles/d37e7ae615d44a709c874db9d5fa0d2f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:05:45.258273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96f758-8621-450a-a35f-bd7d5ab0fe3a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.258857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96f758-8621-450a-a35f-bd7d5ab0fe3a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.258959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96f758-8621-450a-a35f-bd7d5ab0fe3a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.260861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 547/1085] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:45.267043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd917-b8d2-4b7e-8a28-64ce0eec2924 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.267584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd917-b8d2-4b7e-8a28-64ce0eec2924 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.267584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd917-b8d2-4b7e-8a28-64ce0eec2924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.285006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-adacd917-b8d2-4b7e-8a28-64ce0eec2924 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:45.286214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-adacd917-b8d2-4b7e-8a28-64ce0eec2924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:45.301331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:45.353745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 539/1086] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:45.377141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96f758-8621-450a-a35f-bd7d5ab0fe3a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:45.436223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:45.447744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0031fe0-0e5a-45b5-956e-dc376f7e2523 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.448033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0031fe0-0e5a-45b5-956e-dc376f7e2523 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.448328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0031fe0-0e5a-45b5-956e-dc376f7e2523 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.449705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 540/1087] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:45.454688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b653d8-a520-425b-9c48-236e1e213e65 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.454977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b653d8-a520-425b-9c48-236e1e213e65 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.455260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b653d8-a520-425b-9c48-236e1e213e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.471750 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d1b653d8-a520-425b-9c48-236e1e213e65 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:45.472964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d1b653d8-a520-425b-9c48-236e1e213e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:45.479169 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96f758-8621-450a-a35f-bd7d5ab0fe3a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:45.512513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8711-2f21-4458-9a53-e15db904aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:45.513328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8711-2f21-4458-9a53-e15db904aee8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.513615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8711-2f21-4458-9a53-e15db904aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.513888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8711-2f21-4458-9a53-e15db904aee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.524244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d8711-2f21-4458-9a53-e15db904aee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f95d8711-2f21-4458-9a53-e15db904aee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:45.531860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:45.532774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:05:45.538822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 548/1088] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:05:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:45.540219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 541/1089] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:45.541146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8711-2f21-4458-9a53-e15db904aee8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:45.562587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b653d8-a520-425b-9c48-236e1e213e65 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:45.641660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:45.642051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8711-2f21-4458-9a53-e15db904aee8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:45.661781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b653d8-a520-425b-9c48-236e1e213e65 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:45.662330 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:45.676678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea63260-0936-4448-ab43-9609cda3db2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:45.677348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63260-0936-4448-ab43-9609cda3db2f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.677636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63260-0936-4448-ab43-9609cda3db2f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.677915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63260-0936-4448-ab43-9609cda3db2f None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.678657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea63260-0936-4448-ab43-9609cda3db2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:45.685848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea63260-0936-4448-ab43-9609cda3db2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:45.685848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea63260-0936-4448-ab43-9609cda3db2f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:45.689842 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 549/1090] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:05:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:45.695340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea63260-0936-4448-ab43-9609cda3db2f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:45.697020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c83d76-7e52-42df-b305-96ad99239b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:45.697834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c83d76-7e52-42df-b305-96ad99239b13 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.698118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c83d76-7e52-42df-b305-96ad99239b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.698395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c83d76-7e52-42df-b305-96ad99239b13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.708810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c83d76-7e52-42df-b305-96ad99239b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-41c83d76-7e52-42df-b305-96ad99239b13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:05:45.717298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:45.718344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:45.719288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 542/1091] 10.222.0.15 () {56 vars in 1120 bytes} [Thu May 26 03:05:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:45.724132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c83d76-7e52-42df-b305-96ad99239b13 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:45.795089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea63260-0936-4448-ab43-9609cda3db2f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:45.824063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c83d76-7e52-42df-b305-96ad99239b13 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:45.829875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec6b8f-4204-4bd0-bba3-3e2ce5803eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:45.830744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec6b8f-4204-4bd0-bba3-3e2ce5803eae None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.831022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec6b8f-4204-4bd0-bba3-3e2ce5803eae None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.831293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec6b8f-4204-4bd0-bba3-3e2ce5803eae None admin] PATH_INFO: `/v3/users/7b1137577f2f46ff99ca3f831481c5de` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.834497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec6b8f-4204-4bd0-bba3-3e2ce5803eae None admin] RBAC: Authorizing `identity:get_user(user_id=7b1137577f2f46ff99ca3f831481c5de)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:45.834497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec6b8f-4204-4bd0-bba3-3e2ce5803eae None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:45.835850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 550/1092] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:05:45 2022] GET /identity/v3/users/7b1137577f2f46ff99ca3f831481c5de => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:45.841355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec6b8f-4204-4bd0-bba3-3e2ce5803eae None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:45.860736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bd1d9-e616-4ff8-ab86-48d9851ae9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:45.861438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bd1d9-e616-4ff8-ab86-48d9851ae9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.861724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bd1d9-e616-4ff8-ab86-48d9851ae9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.862005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bd1d9-e616-4ff8-ab86-48d9851ae9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.862753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bd1d9-e616-4ff8-ab86-48d9851ae9c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:45.863062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bd1d9-e616-4ff8-ab86-48d9851ae9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:45.864462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bd1d9-e616-4ff8-ab86-48d9851ae9c0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:45.872916 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 543/1093] 10.222.0.15 () {56 vars in 1115 bytes} [Thu May 26 03:05:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:45.878490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bd1d9-e616-4ff8-ab86-48d9851ae9c0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:45.881086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:45.891847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:45.939745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec6b8f-4204-4bd0-bba3-3e2ce5803eae None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:45.973742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b39da-a8f7-48cb-b3b1-76199eb38af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:45.974437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b39da-a8f7-48cb-b3b1-76199eb38af7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:45.974716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b39da-a8f7-48cb-b3b1-76199eb38af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:45.974999 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b39da-a8f7-48cb-b3b1-76199eb38af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:45.979773 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bd1d9-e616-4ff8-ab86-48d9851ae9c0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:46.013945 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24898e0b-41f3-40a8-9923-7100e60ca874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:46.014777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24898e0b-41f3-40a8-9923-7100e60ca874 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:46.015059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24898e0b-41f3-40a8-9923-7100e60ca874 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:46.015332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24898e0b-41f3-40a8-9923-7100e60ca874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:46.026601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24898e0b-41f3-40a8-9923-7100e60ca874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:46.028051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24898e0b-41f3-40a8-9923-7100e60ca874 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:46.044210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b39da-a8f7-48cb-b3b1-76199eb38af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:46.045733 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b39da-a8f7-48cb-b3b1-76199eb38af7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-24898e0b-41f3-40a8-9923-7100e60ca874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:46.045843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:46.046846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:46.047934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:46.047934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:46.047934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:46.047934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:46.047934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 544/1094] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:46.052630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24898e0b-41f3-40a8-9923-7100e60ca874 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:46.096196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:46.106629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:46.146821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 551/1095] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 03:05:46.149040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24898e0b-41f3-40a8-9923-7100e60ca874 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:46.152754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b39da-a8f7-48cb-b3b1-76199eb38af7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:46.183100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0c7e5-5887-44fa-a15a-4c37886ca235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:46.183753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0c7e5-5887-44fa-a15a-4c37886ca235 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:46.184030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0c7e5-5887-44fa-a15a-4c37886ca235 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:46.184299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0c7e5-5887-44fa-a15a-4c37886ca235 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:46.185052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0c7e5-5887-44fa-a15a-4c37886ca235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:46.185338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0c7e5-5887-44fa-a15a-4c37886ca235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:46.191744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0c7e5-5887-44fa-a15a-4c37886ca235 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:46.198122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 545/1096] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:46.204125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0c7e5-5887-44fa-a15a-4c37886ca235 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:46.250045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b39da-a8f7-48cb-b3b1-76199eb38af7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:46.283454 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce1da8-1cc1-4867-ab7c-8294cdd0d44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:46.284338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce1da8-1cc1-4867-ab7c-8294cdd0d44c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:46.284729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce1da8-1cc1-4867-ab7c-8294cdd0d44c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:46.285007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce1da8-1cc1-4867-ab7c-8294cdd0d44c None admin] PATH_INFO: `/v3/projects/2830b8086f8a49ffb945672c63d68aa9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:46.286182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce1da8-1cc1-4867-ab7c-8294cdd0d44c None admin] RBAC: Authorizing `identity:get_project(project_id=2830b8086f8a49ffb945672c63d68aa9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:46.287604 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce1da8-1cc1-4867-ab7c-8294cdd0d44c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:46.289321 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 552/1097] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:05:46 2022] GET /identity/v3/projects/2830b8086f8a49ffb945672c63d68aa9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:46.295949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce1da8-1cc1-4867-ab7c-8294cdd0d44c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:46.306989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0c7e5-5887-44fa-a15a-4c37886ca235 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:46.314495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:46.320451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:46.339738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9c8bc-c351-470f-a2be-b9f0fb835b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:46.340565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9c8bc-c351-470f-a2be-b9f0fb835b22 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:46.340854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9c8bc-c351-470f-a2be-b9f0fb835b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:46.341131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9c8bc-c351-470f-a2be-b9f0fb835b22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:46.348008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9c8bc-c351-470f-a2be-b9f0fb835b22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:46.349504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9c8bc-c351-470f-a2be-b9f0fb835b22 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-dfb9c8bc-c351-470f-a2be-b9f0fb835b22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:05:46.364081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:46.365291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:46.366274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 546/1098] 10.222.0.15 () {56 vars in 1093 bytes} [Thu May 26 03:05:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:46.371553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9c8bc-c351-470f-a2be-b9f0fb835b22 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:46.400071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce1da8-1cc1-4867-ab7c-8294cdd0d44c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:46.433146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdcb2c-b53f-44b7-81ac-77e505bc53a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:46.433790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdcb2c-b53f-44b7-81ac-77e505bc53a0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:46.434069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdcb2c-b53f-44b7-81ac-77e505bc53a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:46.434339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdcb2c-b53f-44b7-81ac-77e505bc53a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:46.435153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdcb2c-b53f-44b7-81ac-77e505bc53a0 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=2830b8086f8a49ffb945672c63d68aa9, user.id=7b1137577f2f46ff99ca3f831481c5de) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:46.435459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdcb2c-b53f-44b7-81ac-77e505bc53a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:46.436905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdcb2c-b53f-44b7-81ac-77e505bc53a0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:46.442821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 553/1099] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:46 2022] GET /identity/v3/role_assignments?user.id=7b1137577f2f46ff99ca3f831481c5de&scope.project.id=2830b8086f8a49ffb945672c63d68aa9&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:46.469873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9c8bc-c351-470f-a2be-b9f0fb835b22 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:46.506043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c407afe-8112-416d-a32d-5c6db2cd27fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:46.506739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c407afe-8112-416d-a32d-5c6db2cd27fb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:46.507028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c407afe-8112-416d-a32d-5c6db2cd27fb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:46.507305 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c407afe-8112-416d-a32d-5c6db2cd27fb None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:46.508166 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c407afe-8112-416d-a32d-5c6db2cd27fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:46.508589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c407afe-8112-416d-a32d-5c6db2cd27fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:46.510081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c407afe-8112-416d-a32d-5c6db2cd27fb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:46.529670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 547/1100] 10.222.0.15 () {56 vars in 1133 bytes} [Thu May 26 03:05:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:46.535578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdcb2c-b53f-44b7-81ac-77e505bc53a0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:46.621291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:46.638983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdcb2c-b53f-44b7-81ac-77e505bc53a0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:46.676209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167b79-b077-4549-b003-c93976fca231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:46.676925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167b79-b077-4549-b003-c93976fca231 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:46.677212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167b79-b077-4549-b003-c93976fca231 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:46.677490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167b79-b077-4549-b003-c93976fca231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:46.744691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1167b79-b077-4549-b003-c93976fca231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:46.746145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1167b79-b077-4549-b003-c93976fca231 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:46.827467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:46.846899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 554/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 03:05:46.852771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c407afe-8112-416d-a32d-5c6db2cd27fb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:46.882935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:46.950763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c407afe-8112-416d-a32d-5c6db2cd27fb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:46.984732 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e803f3a-ae23-4619-b2a9-d92bf3bc8351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:46.985528 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e803f3a-ae23-4619-b2a9-d92bf3bc8351 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:46.985814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e803f3a-ae23-4619-b2a9-d92bf3bc8351 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:46.986092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e803f3a-ae23-4619-b2a9-d92bf3bc8351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:46.995934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e803f3a-ae23-4619-b2a9-d92bf3bc8351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:46.997424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e803f3a-ae23-4619-b2a9-d92bf3bc8351 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4e803f3a-ae23-4619-b2a9-d92bf3bc8351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:05:47.015834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:47.017043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:47.018242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:05:47.018242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:05:47.018242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:05:47.018242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:47.020586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 548/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:05:47.022634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167b79-b077-4549-b003-c93976fca231 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:47.117977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167b79-b077-4549-b003-c93976fca231 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:47.151027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42b8b0-de77-45cb-986e-fcb892e8726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:47.151611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42b8b0-de77-45cb-986e-fcb892e8726f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:47.151889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42b8b0-de77-45cb-986e-fcb892e8726f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:47.152161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42b8b0-de77-45cb-986e-fcb892e8726f None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:47.152900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42b8b0-de77-45cb-986e-fcb892e8726f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:47.153204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42b8b0-de77-45cb-986e-fcb892e8726f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:47.154546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42b8b0-de77-45cb-986e-fcb892e8726f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:47.165548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 555/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:47.170972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e803f3a-ae23-4619-b2a9-d92bf3bc8351 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:47.251875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:47.269329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e803f3a-ae23-4619-b2a9-d92bf3bc8351 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:47.303831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7199e-8ea1-49db-9985-bdf1d9f3448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:47.304638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7199e-8ea1-49db-9985-bdf1d9f3448e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:47.304915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7199e-8ea1-49db-9985-bdf1d9f3448e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:47.305184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7199e-8ea1-49db-9985-bdf1d9f3448e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:47.312137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7199e-8ea1-49db-9985-bdf1d9f3448e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:47.313600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7199e-8ea1-49db-9985-bdf1d9f3448e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-afc7199e-8ea1-49db-9985-bdf1d9f3448e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:05:47.327326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:05:47.328424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:05:47.329346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:05:47.329346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:05:47.329346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:05:47.329346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:05:47.329346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:05:47.329346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:05:47.329346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:05:47.329346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:05:47.329346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 549/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:05:47.334237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42b8b0-de77-45cb-986e-fcb892e8726f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:47.376518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:47.431546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42b8b0-de77-45cb-986e-fcb892e8726f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:47.464173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60cd33-d035-4d53-a4cd-e08a19662eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:47.464872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60cd33-d035-4d53-a4cd-e08a19662eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:47.465157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60cd33-d035-4d53-a4cd-e08a19662eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:47.465433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60cd33-d035-4d53-a4cd-e08a19662eb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:47.466205 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60cd33-d035-4d53-a4cd-e08a19662eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:47.466515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60cd33-d035-4d53-a4cd-e08a19662eb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:47.467924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60cd33-d035-4d53-a4cd-e08a19662eb6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:47.479709 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 556/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:47.485650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7199e-8ea1-49db-9985-bdf1d9f3448e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:47.581686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7199e-8ea1-49db-9985-bdf1d9f3448e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:47.616293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2297-7bcf-40f6-9a0d-fdc08c48668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:47.616963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2297-7bcf-40f6-9a0d-fdc08c48668a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:47.617246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2297-7bcf-40f6-9a0d-fdc08c48668a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:47.617522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2297-7bcf-40f6-9a0d-fdc08c48668a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:47.618887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2297-7bcf-40f6-9a0d-fdc08c48668a None admin] RBAC: Adding query filter params (role.id=d37e7ae615d44a709c874db9d5fa0d2f, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=51f966be1d764324b7695e1caf578291) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:47.619196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2297-7bcf-40f6-9a0d-fdc08c48668a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:47.620651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2297-7bcf-40f6-9a0d-fdc08c48668a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:47.626497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 550/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:47 2022] GET /identity/v3/role_assignments?user.id=51f966be1d764324b7695e1caf578291&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=d37e7ae615d44a709c874db9d5fa0d2f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:48.681290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc90a-8045-4d21-823b-1df858875656 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:48.681850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc90a-8045-4d21-823b-1df858875656 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:48.681850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc90a-8045-4d21-823b-1df858875656 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:48.683214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 557/1107] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:48.688589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4aed2-0f7c-40a2-bc86-7eacc362935f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:48.689028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4aed2-0f7c-40a2-bc86-7eacc362935f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:48.689153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4aed2-0f7c-40a2-bc86-7eacc362935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:48.706152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f0a4aed2-0f7c-40a2-bc86-7eacc362935f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:48.707327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f0a4aed2-0f7c-40a2-bc86-7eacc362935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:48.709248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:48.771496 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 551/1108] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:48.795846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cc90a-8045-4d21-823b-1df858875656 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:48.894784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cc90a-8045-4d21-823b-1df858875656 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:48.896276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:48.927751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5e656-9e63-4906-9494-fac60ce0b952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:48.928559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5e656-9e63-4906-9494-fac60ce0b952 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:48.928846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5e656-9e63-4906-9494-fac60ce0b952 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:48.929131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5e656-9e63-4906-9494-fac60ce0b952 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:48.930814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5e656-9e63-4906-9494-fac60ce0b952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:48.932296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5e656-9e63-4906-9494-fac60ce0b952 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:48.933871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 558/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:05:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:48.939490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4aed2-0f7c-40a2-bc86-7eacc362935f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:49.033067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4aed2-0f7c-40a2-bc86-7eacc362935f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:49.065606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ece01-629d-4537-84e7-18c60fe32c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:49.066253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ece01-629d-4537-84e7-18c60fe32c4b None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:49.066535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ece01-629d-4537-84e7-18c60fe32c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:49.066808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ece01-629d-4537-84e7-18c60fe32c4b None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:49.067513 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ece01-629d-4537-84e7-18c60fe32c4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:49.068972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ece01-629d-4537-84e7-18c60fe32c4b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:49.077286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:49.147854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 552/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:05:48 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:05:51.333566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc6fe-d835-45ce-8623-252b8b13ce46 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:51.334092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc6fe-d835-45ce-8623-252b8b13ce46 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:51.334187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc6fe-d835-45ce-8623-252b8b13ce46 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:51.335754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 559/1111] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:51.341627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7a60c-0eb0-48b7-acab-38792cce32df None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:51.342047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7a60c-0eb0-48b7-acab-38792cce32df None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:51.342219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7a60c-0eb0-48b7-acab-38792cce32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:51.358624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5be7a60c-0eb0-48b7-acab-38792cce32df None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:51.359799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5be7a60c-0eb0-48b7-acab-38792cce32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:51.423096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 553/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:51.446964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc6fe-d835-45ce-8623-252b8b13ce46 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:51.546185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc6fe-d835-45ce-8623-252b8b13ce46 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:51.578906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4973a3-7d38-4fda-bd83-410437ddd4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:51.579745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4973a3-7d38-4fda-bd83-410437ddd4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:51.580029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4973a3-7d38-4fda-bd83-410437ddd4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:51.580303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4973a3-7d38-4fda-bd83-410437ddd4d2 None admin] PATH_INFO: `/v3/roles/90baedc1773f4d67ae7e85fa74a93b5d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:51.581781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4973a3-7d38-4fda-bd83-410437ddd4d2 None admin] RBAC: Authorizing `identity:get_role(role_id=90baedc1773f4d67ae7e85fa74a93b5d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:51.583139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4973a3-7d38-4fda-bd83-410437ddd4d2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:51.584809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 560/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:05:51 2022] GET /identity/v3/roles/90baedc1773f4d67ae7e85fa74a93b5d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:51.590840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7a60c-0eb0-48b7-acab-38792cce32df None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:51.685117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7a60c-0eb0-48b7-acab-38792cce32df None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:51.708246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:51.718638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a99d2d-10d2-4931-8ee8-b1019ac430bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:51.727127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a99d2d-10d2-4931-8ee8-b1019ac430bb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:51.727127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a99d2d-10d2-4931-8ee8-b1019ac430bb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:51.727127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a99d2d-10d2-4931-8ee8-b1019ac430bb None admin] PATH_INFO: `/v3/users/e288fc295b4f4b10897a88620f0e70c7` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:51.732610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a99d2d-10d2-4931-8ee8-b1019ac430bb None admin] RBAC: Authorizing `identity:get_user(user_id=e288fc295b4f4b10897a88620f0e70c7)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:51.734058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a99d2d-10d2-4931-8ee8-b1019ac430bb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:51.735670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 554/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:05:51 2022] GET /identity/v3/users/e288fc295b4f4b10897a88620f0e70c7 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:51.741348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4973a3-7d38-4fda-bd83-410437ddd4d2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:51.780426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:51.838728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4973a3-7d38-4fda-bd83-410437ddd4d2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:51.871358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2c88e-52b4-4e26-b920-366ac686e0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:51.872003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2c88e-52b4-4e26-b920-366ac686e0cc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:51.872286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2c88e-52b4-4e26-b920-366ac686e0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:51.872599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2c88e-52b4-4e26-b920-366ac686e0cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:51.937221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2c88e-52b4-4e26-b920-366ac686e0cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:51.938663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2c88e-52b4-4e26-b920-366ac686e0cc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:51.975596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:52.073023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 561/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:05:52.079070 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a99d2d-10d2-4931-8ee8-b1019ac430bb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:52.173876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a99d2d-10d2-4931-8ee8-b1019ac430bb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:52.205616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232c640-2d2e-4ca7-88f3-029e2f26070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:52.206450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c640-2d2e-4ca7-88f3-029e2f26070e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:52.206727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c640-2d2e-4ca7-88f3-029e2f26070e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:52.206995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c640-2d2e-4ca7-88f3-029e2f26070e None admin] PATH_INFO: `/v3/projects/2830b8086f8a49ffb945672c63d68aa9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:52.208139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232c640-2d2e-4ca7-88f3-029e2f26070e None admin] RBAC: Authorizing `identity:get_project(project_id=2830b8086f8a49ffb945672c63d68aa9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:52.209829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232c640-2d2e-4ca7-88f3-029e2f26070e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:52.211510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 555/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:05:52 2022] GET /identity/v3/projects/2830b8086f8a49ffb945672c63d68aa9 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:52.217970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2c88e-52b4-4e26-b920-366ac686e0cc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:52.312853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2c88e-52b4-4e26-b920-366ac686e0cc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:52.345922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516cc06-15f2-40a2-aa19-9f991c970336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:52.346560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516cc06-15f2-40a2-aa19-9f991c970336 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:52.346829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516cc06-15f2-40a2-aa19-9f991c970336 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:52.347109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516cc06-15f2-40a2-aa19-9f991c970336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:52.347927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516cc06-15f2-40a2-aa19-9f991c970336 None admin] RBAC: Adding query filter params (role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=2830b8086f8a49ffb945672c63d68aa9, user.id=e288fc295b4f4b10897a88620f0e70c7) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:52.348242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516cc06-15f2-40a2-aa19-9f991c970336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:52.349685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516cc06-15f2-40a2-aa19-9f991c970336 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:52.354954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 562/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:52 2022] GET /identity/v3/role_assignments?user.id=e288fc295b4f4b10897a88620f0e70c7&scope.project.id=2830b8086f8a49ffb945672c63d68aa9&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:54.474184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c628d-3a81-4782-9241-e0e38f8da0bc None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:54.474711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c628d-3a81-4782-9241-e0e38f8da0bc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:54.474711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c628d-3a81-4782-9241-e0e38f8da0bc None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:54.476081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 556/1118] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:54.481831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d4b73-30a5-4db4-bfd3-4ba9fd6e3ad5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:54.482249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d4b73-30a5-4db4-bfd3-4ba9fd6e3ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:54.482394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d4b73-30a5-4db4-bfd3-4ba9fd6e3ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:54.487393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:54.499765 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-370d4b73-30a5-4db4-bfd3-4ba9fd6e3ad5 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:54.512735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-370d4b73-30a5-4db4-bfd3-4ba9fd6e3ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:54.565201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 563/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:05:54.587102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c628d-3a81-4782-9241-e0e38f8da0bc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:54.637065 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:54.685179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c628d-3a81-4782-9241-e0e38f8da0bc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:54.717427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aec1ad-21d4-4cce-8bc3-5b8a5c5f63b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:54.718270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec1ad-21d4-4cce-8bc3-5b8a5c5f63b2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:54.718551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec1ad-21d4-4cce-8bc3-5b8a5c5f63b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:54.718825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec1ad-21d4-4cce-8bc3-5b8a5c5f63b2 None admin] PATH_INFO: `/v3/roles/90baedc1773f4d67ae7e85fa74a93b5d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:54.720286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aec1ad-21d4-4cce-8bc3-5b8a5c5f63b2 None admin] RBAC: Authorizing `identity:get_role(role_id=90baedc1773f4d67ae7e85fa74a93b5d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:54.721686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aec1ad-21d4-4cce-8bc3-5b8a5c5f63b2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:54.723053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 557/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:05:54 2022] GET /identity/v3/roles/90baedc1773f4d67ae7e85fa74a93b5d => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:54.729361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d4b73-30a5-4db4-bfd3-4ba9fd6e3ad5 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:54.830442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d4b73-30a5-4db4-bfd3-4ba9fd6e3ad5 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:54.864531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:54.869488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb715a-11af-46a5-809c-dbe90cfb159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:54.870354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb715a-11af-46a5-809c-dbe90cfb159a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:54.870639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb715a-11af-46a5-809c-dbe90cfb159a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:54.870916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb715a-11af-46a5-809c-dbe90cfb159a None admin] PATH_INFO: `/v3/users/e288fc295b4f4b10897a88620f0e70c7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:54.872085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb715a-11af-46a5-809c-dbe90cfb159a None admin] RBAC: Authorizing `identity:get_user(user_id=e288fc295b4f4b10897a88620f0e70c7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:54.873549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb715a-11af-46a5-809c-dbe90cfb159a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:54.875164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 564/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:05:54 2022] GET /identity/v3/users/e288fc295b4f4b10897a88620f0e70c7 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:54.881123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aec1ad-21d4-4cce-8bc3-5b8a5c5f63b2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:54.977984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aec1ad-21d4-4cce-8bc3-5b8a5c5f63b2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:54.994394 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:55.010991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3239c-e383-4160-92ed-ed86a2a29b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:55.011838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3239c-e383-4160-92ed-ed86a2a29b2b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:55.012121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3239c-e383-4160-92ed-ed86a2a29b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:55.012421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3239c-e383-4160-92ed-ed86a2a29b2b None admin] PATH_INFO: `/v3/projects/2830b8086f8a49ffb945672c63d68aa9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:55.013577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3239c-e383-4160-92ed-ed86a2a29b2b None admin] RBAC: Authorizing `identity:get_project(project_id=2830b8086f8a49ffb945672c63d68aa9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:55.015001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3239c-e383-4160-92ed-ed86a2a29b2b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:55.016796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 558/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:05:54 2022] GET /identity/v3/projects/2830b8086f8a49ffb945672c63d68aa9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:55.023051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb715a-11af-46a5-809c-dbe90cfb159a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:55.119611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb715a-11af-46a5-809c-dbe90cfb159a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:55.152672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa425718-0acb-4852-8c32-214fa2f3e92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:55.153547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa425718-0acb-4852-8c32-214fa2f3e92d None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:55.153826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa425718-0acb-4852-8c32-214fa2f3e92d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:55.154100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa425718-0acb-4852-8c32-214fa2f3e92d None admin] PATH_INFO: `/v3/projects/2830b8086f8a49ffb945672c63d68aa9/users/e288fc295b4f4b10897a88620f0e70c7/roles/90baedc1773f4d67ae7e85fa74a93b5d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:55.156261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa425718-0acb-4852-8c32-214fa2f3e92d None admin] RBAC: Authorizing `identity:create_grant(project_id=2830b8086f8a49ffb945672c63d68aa9, user_id=e288fc295b4f4b10897a88620f0e70c7, role_id=90baedc1773f4d67ae7e85fa74a93b5d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:55.157705 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa425718-0acb-4852-8c32-214fa2f3e92d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:55.245114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 565/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:05:55 2022] PUT /identity/v3/projects/2830b8086f8a49ffb945672c63d68aa9/users/e288fc295b4f4b10897a88620f0e70c7/roles/90baedc1773f4d67ae7e85fa74a93b5d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:05:57.378617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf20ce-e038-4a3d-a2c6-ea9ea89c9504 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:57.379177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf20ce-e038-4a3d-a2c6-ea9ea89c9504 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:57.379177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf20ce-e038-4a3d-a2c6-ea9ea89c9504 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:57.380546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 559/1124] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:05:57.386168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b371d0-b8b9-4a4d-8c9c-82c650853481 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:57.386534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b371d0-b8b9-4a4d-8c9c-82c650853481 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:57.386729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b371d0-b8b9-4a4d-8c9c-82c650853481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:57.403741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c7b371d0-b8b9-4a4d-8c9c-82c650853481 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:05:57.404936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c7b371d0-b8b9-4a4d-8c9c-82c650853481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:05:57.457664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:57.469217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 566/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:05:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:05:57.492238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf20ce-e038-4a3d-a2c6-ea9ea89c9504 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:57.588605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf20ce-e038-4a3d-a2c6-ea9ea89c9504 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:57.621096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76bce-520b-4618-8718-ac68680b3a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:57.621926 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76bce-520b-4618-8718-ac68680b3a9d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:57.622203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76bce-520b-4618-8718-ac68680b3a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:57.622476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76bce-520b-4618-8718-ac68680b3a9d None admin] PATH_INFO: `/v3/roles/90baedc1773f4d67ae7e85fa74a93b5d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:57.623906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e76bce-520b-4618-8718-ac68680b3a9d None admin] RBAC: Authorizing `identity:get_role(role_id=90baedc1773f4d67ae7e85fa74a93b5d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:57.625292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e76bce-520b-4618-8718-ac68680b3a9d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:57.626613 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 560/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:05:57 2022] GET /identity/v3/roles/90baedc1773f4d67ae7e85fa74a93b5d => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:57.632235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b371d0-b8b9-4a4d-8c9c-82c650853481 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:57.725895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b371d0-b8b9-4a4d-8c9c-82c650853481 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:57.757880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3987c48-f32a-4cb3-9610-bc78199ca2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:57.758746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3987c48-f32a-4cb3-9610-bc78199ca2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:57.759022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3987c48-f32a-4cb3-9610-bc78199ca2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:57.759288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3987c48-f32a-4cb3-9610-bc78199ca2b9 None admin] PATH_INFO: `/v3/users/e288fc295b4f4b10897a88620f0e70c7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:57.760459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3987c48-f32a-4cb3-9610-bc78199ca2b9 None admin] RBAC: Authorizing `identity:get_user(user_id=e288fc295b4f4b10897a88620f0e70c7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:57.761870 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3987c48-f32a-4cb3-9610-bc78199ca2b9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:57.763430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 567/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:05:57 2022] GET /identity/v3/users/e288fc295b4f4b10897a88620f0e70c7 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:05:57.768850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76bce-520b-4618-8718-ac68680b3a9d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:57.822159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:57.864957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76bce-520b-4618-8718-ac68680b3a9d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:57.896797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2cb61-b20e-49e4-a292-5657fae76c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:57.897375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2cb61-b20e-49e4-a292-5657fae76c11 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:57.897659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2cb61-b20e-49e4-a292-5657fae76c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:57.897936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2cb61-b20e-49e4-a292-5657fae76c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:57.962630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2cb61-b20e-49e4-a292-5657fae76c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:57.964087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2cb61-b20e-49e4-a292-5657fae76c11 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:58.014565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:58.057217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 561/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:05:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:05:58.063046 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3987c48-f32a-4cb3-9610-bc78199ca2b9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:58.120329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:05:58.162253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3987c48-f32a-4cb3-9610-bc78199ca2b9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:58.193865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284a743-e774-4dfb-9b23-a91831eefb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:58.194710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a743-e774-4dfb-9b23-a91831eefb2b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:58.194995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a743-e774-4dfb-9b23-a91831eefb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:58.195274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a743-e774-4dfb-9b23-a91831eefb2b None admin] PATH_INFO: `/v3/projects/2830b8086f8a49ffb945672c63d68aa9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:58.196986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284a743-e774-4dfb-9b23-a91831eefb2b None admin] RBAC: Authorizing `identity:get_project(project_id=2830b8086f8a49ffb945672c63d68aa9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:58.198396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284a743-e774-4dfb-9b23-a91831eefb2b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:58.200051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 568/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:05:58 2022] GET /identity/v3/projects/2830b8086f8a49ffb945672c63d68aa9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:05:58.205932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2cb61-b20e-49e4-a292-5657fae76c11 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:05:58.300179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2cb61-b20e-49e4-a292-5657fae76c11 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:05:58.332431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9042a-58e8-4555-9a24-fd6f31ae7f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:05:58.333064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9042a-58e8-4555-9a24-fd6f31ae7f69 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:05:58.333347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9042a-58e8-4555-9a24-fd6f31ae7f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:05:58.333621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9042a-58e8-4555-9a24-fd6f31ae7f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:05:58.334439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9042a-58e8-4555-9a24-fd6f31ae7f69 None admin] RBAC: Adding query filter params (role.id=90baedc1773f4d67ae7e85fa74a93b5d, scope.project.id=2830b8086f8a49ffb945672c63d68aa9, user.id=e288fc295b4f4b10897a88620f0e70c7) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:05:58.334998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9042a-58e8-4555-9a24-fd6f31ae7f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:05:58.336439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9042a-58e8-4555-9a24-fd6f31ae7f69 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:05:58.342574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 562/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:05:58 2022] GET /identity/v3/role_assignments?user.id=e288fc295b4f4b10897a88620f0e70c7&scope.project.id=2830b8086f8a49ffb945672c63d68aa9&role.id=90baedc1773f4d67ae7e85fa74a93b5d => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:00.517276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d01d2-d15d-49e8-978f-e33938ba8d05 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:00.517799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d01d2-d15d-49e8-978f-e33938ba8d05 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:00.517799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d01d2-d15d-49e8-978f-e33938ba8d05 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:00.519183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 569/1131] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:00.524980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576ace0-86d6-4403-9ecc-d5494e2f8e00 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:00.525410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576ace0-86d6-4403-9ecc-d5494e2f8e00 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:00.525539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576ace0-86d6-4403-9ecc-d5494e2f8e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:00.541741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e576ace0-86d6-4403-9ecc-d5494e2f8e00 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:00.542911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e576ace0-86d6-4403-9ecc-d5494e2f8e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:00.555499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:00.606763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 563/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:06:00.629267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d01d2-d15d-49e8-978f-e33938ba8d05 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:00.728196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d01d2-d15d-49e8-978f-e33938ba8d05 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:00.752957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:00.761775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269cd9e-55e1-4914-bcda-8b65707cdb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:00.762691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269cd9e-55e1-4914-bcda-8b65707cdb04 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:00.763004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269cd9e-55e1-4914-bcda-8b65707cdb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:00.763284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269cd9e-55e1-4914-bcda-8b65707cdb04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:00.764493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269cd9e-55e1-4914-bcda-8b65707cdb04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:00.765915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269cd9e-55e1-4914-bcda-8b65707cdb04 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:00.767557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 570/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:06:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:00.773135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576ace0-86d6-4403-9ecc-d5494e2f8e00 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:00.867064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576ace0-86d6-4403-9ecc-d5494e2f8e00 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:00.900216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37be2-210a-4602-b243-581d7b8bc8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:00.900885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37be2-210a-4602-b243-581d7b8bc8c2 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:00.901164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37be2-210a-4602-b243-581d7b8bc8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:00.901435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37be2-210a-4602-b243-581d7b8bc8c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:00.902144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37be2-210a-4602-b243-581d7b8bc8c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:00.903570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37be2-210a-4602-b243-581d7b8bc8c2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:00.978102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:00.984043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 564/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:06:00 2022] POST /identity/v3/projects => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:06:03.163795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47dae-9ab0-4910-9a1d-73170ebce78d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:03.164283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47dae-9ab0-4910-9a1d-73170ebce78d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:03.164283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47dae-9ab0-4910-9a1d-73170ebce78d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:03.166276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 571/1135] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:03.171536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817357b0-1224-4893-a9d3-30eba62362da None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:03.171944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817357b0-1224-4893-a9d3-30eba62362da None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:03.172098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817357b0-1224-4893-a9d3-30eba62362da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:03.188516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-817357b0-1224-4893-a9d3-30eba62362da None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:03.189684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-817357b0-1224-4893-a9d3-30eba62362da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:03.253500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 565/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:03.278092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47dae-9ab0-4910-9a1d-73170ebce78d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:03.378073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47dae-9ab0-4910-9a1d-73170ebce78d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:03.410574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09111b-d4f4-461a-a066-93a0f973f0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:03.411342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09111b-d4f4-461a-a066-93a0f973f0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:03.411621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09111b-d4f4-461a-a066-93a0f973f0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:03.411891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09111b-d4f4-461a-a066-93a0f973f0c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:03.413052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09111b-d4f4-461a-a066-93a0f973f0c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:03.414517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09111b-d4f4-461a-a066-93a0f973f0c8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:03.416067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 572/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:06:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:03.421703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817357b0-1224-4893-a9d3-30eba62362da None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:03.515878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817357b0-1224-4893-a9d3-30eba62362da None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:03.543691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:03.549269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b112a6f-7ec8-4bea-9a35-c1f07be4af14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:03.549923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b112a6f-7ec8-4bea-9a35-c1f07be4af14 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:03.550204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b112a6f-7ec8-4bea-9a35-c1f07be4af14 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:03.550477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b112a6f-7ec8-4bea-9a35-c1f07be4af14 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:03.551170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b112a6f-7ec8-4bea-9a35-c1f07be4af14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:03.552630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b112a6f-7ec8-4bea-9a35-c1f07be4af14 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:03.651289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 566/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:06:03 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:06:05.862028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7123fe-a30c-41ea-af77-577e31f55768 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:05.862028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7123fe-a30c-41ea-af77-577e31f55768 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:05.862028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7123fe-a30c-41ea-af77-577e31f55768 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:05.862028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 573/1139] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:05.863423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4816-7b5c-4a1a-906b-bc2f26db9dd9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:05.863792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4816-7b5c-4a1a-906b-bc2f26db9dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:05.863990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4816-7b5c-4a1a-906b-bc2f26db9dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:05.881204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d0fa4816-7b5c-4a1a-906b-bc2f26db9dd9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:05.882390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d0fa4816-7b5c-4a1a-906b-bc2f26db9dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:05.946878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 567/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:05.970304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7123fe-a30c-41ea-af77-577e31f55768 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:06.030199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:06.068467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7123fe-a30c-41ea-af77-577e31f55768 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:06.100689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c3b9-4d5d-4633-b5e7-27c1c1f1f9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:06.101457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c3b9-4d5d-4633-b5e7-27c1c1f1f9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:06.101737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c3b9-4d5d-4633-b5e7-27c1c1f1f9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:06.102007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c3b9-4d5d-4633-b5e7-27c1c1f1f9c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:06.112232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c3b9-4d5d-4633-b5e7-27c1c1f1f9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1f33c3b9-4d5d-4633-b5e7-27c1c1f1f9c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:06:06.119768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:06:06.120961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:06:06.122082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 574/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:06:06.126646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4816-7b5c-4a1a-906b-bc2f26db9dd9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:06.220100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4816-7b5c-4a1a-906b-bc2f26db9dd9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:06.236630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:06.253102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf469d-f727-402f-96da-a402999830f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:06.253750 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf469d-f727-402f-96da-a402999830f3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:06.254030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf469d-f727-402f-96da-a402999830f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:06.254302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf469d-f727-402f-96da-a402999830f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:06.255038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf469d-f727-402f-96da-a402999830f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:06.255340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf469d-f727-402f-96da-a402999830f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:06.256801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf469d-f727-402f-96da-a402999830f3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:06.265538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 568/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:06:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:06.271091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c3b9-4d5d-4633-b5e7-27c1c1f1f9c8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:06.367700 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c3b9-4d5d-4633-b5e7-27c1c1f1f9c8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:06.389024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:06.400391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2210-6ede-43b9-b072-e11198b3d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:06.401360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2210-6ede-43b9-b072-e11198b3d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:06.401641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2210-6ede-43b9-b072-e11198b3d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:06.401914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2210-6ede-43b9-b072-e11198b3d7d7 None admin] PATH_INFO: `/v3/users/47d849d8cac44f5ca9716f8c83cede9c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:06.414481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2210-6ede-43b9-b072-e11198b3d7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=47d849d8cac44f5ca9716f8c83cede9c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:06.415932 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2210-6ede-43b9-b072-e11198b3d7d7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:06.417575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 575/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:06:06 2022] GET /identity/v3/users/47d849d8cac44f5ca9716f8c83cede9c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:06.423163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf469d-f727-402f-96da-a402999830f3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:06.518779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf469d-f727-402f-96da-a402999830f3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:06.550650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c8621-37e2-48ff-af6f-b5d841ede2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:06.551279 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8621-37e2-48ff-af6f-b5d841ede2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:06.551562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8621-37e2-48ff-af6f-b5d841ede2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:06.551841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8621-37e2-48ff-af6f-b5d841ede2a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:06.595498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:06.615754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c8621-37e2-48ff-af6f-b5d841ede2a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:06.617501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c8621-37e2-48ff-af6f-b5d841ede2a0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:06.711472 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 569/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:06:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:06:06.717086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2210-6ede-43b9-b072-e11198b3d7d7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:06.812090 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2210-6ede-43b9-b072-e11198b3d7d7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:06.845132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f97f-529e-47cc-9b55-4bfbbbdc68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:06.845969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f97f-529e-47cc-9b55-4bfbbbdc68b8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:06.846251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f97f-529e-47cc-9b55-4bfbbbdc68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:06.846523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f97f-529e-47cc-9b55-4bfbbbdc68b8 None admin] PATH_INFO: `/v3/projects/5c2f9989a7224effb0f64aced0b8e7d7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:06.847665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98f97f-529e-47cc-9b55-4bfbbbdc68b8 None admin] RBAC: Authorizing `identity:get_project(project_id=5c2f9989a7224effb0f64aced0b8e7d7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:06.849201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98f97f-529e-47cc-9b55-4bfbbbdc68b8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:06.850843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 576/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:06:06 2022] GET /identity/v3/projects/5c2f9989a7224effb0f64aced0b8e7d7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:06.856784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c8621-37e2-48ff-af6f-b5d841ede2a0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:06.930227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:06.951369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c8621-37e2-48ff-af6f-b5d841ede2a0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:06.983769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1de2b8-6d60-42ba-9250-977d1e5c2766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:06.984374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1de2b8-6d60-42ba-9250-977d1e5c2766 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:06.984661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1de2b8-6d60-42ba-9250-977d1e5c2766 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:06.984936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1de2b8-6d60-42ba-9250-977d1e5c2766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:06.985755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1de2b8-6d60-42ba-9250-977d1e5c2766 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=5c2f9989a7224effb0f64aced0b8e7d7, user.id=47d849d8cac44f5ca9716f8c83cede9c) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:06.986068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1de2b8-6d60-42ba-9250-977d1e5c2766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:06.987486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1de2b8-6d60-42ba-9250-977d1e5c2766 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:06.992749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 570/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:06:06 2022] GET /identity/v3/role_assignments?user.id=47d849d8cac44f5ca9716f8c83cede9c&scope.project.id=5c2f9989a7224effb0f64aced0b8e7d7&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:09.125391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef7d07-6c22-45c3-a93a-7f8a9b0bfc32 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:09.125900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef7d07-6c22-45c3-a93a-7f8a9b0bfc32 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:09.125900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef7d07-6c22-45c3-a93a-7f8a9b0bfc32 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:09.127225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 577/1147] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:09.132688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d630f03-e14f-46c6-9133-123879c74b92 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:09.133075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d630f03-e14f-46c6-9133-123879c74b92 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:09.133244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d630f03-e14f-46c6-9133-123879c74b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:09.150697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0d630f03-e14f-46c6-9133-123879c74b92 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:09.151858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0d630f03-e14f-46c6-9133-123879c74b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:09.214911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 571/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:09.236593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef7d07-6c22-45c3-a93a-7f8a9b0bfc32 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:09.284989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:09.334703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef7d07-6c22-45c3-a93a-7f8a9b0bfc32 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:09.367554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3fda-e14d-40e9-860d-9aeb82cd4ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:09.368986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3fda-e14d-40e9-860d-9aeb82cd4ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:09.369266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3fda-e14d-40e9-860d-9aeb82cd4ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:09.369534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3fda-e14d-40e9-860d-9aeb82cd4ae9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:09.379538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b3fda-e14d-40e9-860d-9aeb82cd4ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-df9b3fda-e14d-40e9-860d-9aeb82cd4ae9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:06:09.387021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:06:09.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:06:09.389277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 578/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:06:09.394382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d630f03-e14f-46c6-9133-123879c74b92 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:09.460733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:09.488552 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d630f03-e14f-46c6-9133-123879c74b92 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:09.521742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e32a6-2df0-40f9-b8b7-5c61359cb760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:09.522393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e32a6-2df0-40f9-b8b7-5c61359cb760 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:09.522676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e32a6-2df0-40f9-b8b7-5c61359cb760 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:09.522949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e32a6-2df0-40f9-b8b7-5c61359cb760 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:09.523684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e32a6-2df0-40f9-b8b7-5c61359cb760 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:09.523988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e32a6-2df0-40f9-b8b7-5c61359cb760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:09.525407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e32a6-2df0-40f9-b8b7-5c61359cb760 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:09.533102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 572/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:09.538887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3fda-e14d-40e9-860d-9aeb82cd4ae9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:09.636877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3fda-e14d-40e9-860d-9aeb82cd4ae9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:09.645228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:09.669909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50850f-3154-46c0-b3b3-b00e907f5af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:09.670747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50850f-3154-46c0-b3b3-b00e907f5af5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:09.671029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50850f-3154-46c0-b3b3-b00e907f5af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:09.671304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50850f-3154-46c0-b3b3-b00e907f5af5 None admin] PATH_INFO: `/v3/users/47d849d8cac44f5ca9716f8c83cede9c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:09.672516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50850f-3154-46c0-b3b3-b00e907f5af5 None admin] RBAC: Authorizing `identity:get_user(user_id=47d849d8cac44f5ca9716f8c83cede9c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:09.673973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50850f-3154-46c0-b3b3-b00e907f5af5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:09.675746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 579/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:06:09 2022] GET /identity/v3/users/47d849d8cac44f5ca9716f8c83cede9c => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:09.681254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e32a6-2df0-40f9-b8b7-5c61359cb760 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:09.776702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e32a6-2df0-40f9-b8b7-5c61359cb760 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:09.808983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8753ce-6f09-4ec2-9937-ebc60e23eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:09.809834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8753ce-6f09-4ec2-9937-ebc60e23eeaa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:09.810116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8753ce-6f09-4ec2-9937-ebc60e23eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:09.810389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8753ce-6f09-4ec2-9937-ebc60e23eeaa None admin] PATH_INFO: `/v3/projects/5c2f9989a7224effb0f64aced0b8e7d7` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:09.811541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8753ce-6f09-4ec2-9937-ebc60e23eeaa None admin] RBAC: Authorizing `identity:get_project(project_id=5c2f9989a7224effb0f64aced0b8e7d7)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:09.813005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8753ce-6f09-4ec2-9937-ebc60e23eeaa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:09.814663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 573/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:06:09 2022] GET /identity/v3/projects/5c2f9989a7224effb0f64aced0b8e7d7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:09.820486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50850f-3154-46c0-b3b3-b00e907f5af5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:09.916018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50850f-3154-46c0-b3b3-b00e907f5af5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:09.947436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89faa64-2654-428e-bd3d-7e3055a833b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:09.948318 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89faa64-2654-428e-bd3d-7e3055a833b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:09.948611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89faa64-2654-428e-bd3d-7e3055a833b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:09.948887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89faa64-2654-428e-bd3d-7e3055a833b4 None admin] PATH_INFO: `/v3/projects/5c2f9989a7224effb0f64aced0b8e7d7/users/47d849d8cac44f5ca9716f8c83cede9c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:09.950794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89faa64-2654-428e-bd3d-7e3055a833b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c2f9989a7224effb0f64aced0b8e7d7, user_id=47d849d8cac44f5ca9716f8c83cede9c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:09.952198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89faa64-2654-428e-bd3d-7e3055a833b4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:10.051221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 580/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:06:09 2022] PUT /identity/v3/projects/5c2f9989a7224effb0f64aced0b8e7d7/users/47d849d8cac44f5ca9716f8c83cede9c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:06:12.181731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79c1a1-aa76-4646-b438-166767b91479 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:12.182226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79c1a1-aa76-4646-b438-166767b91479 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:12.182226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79c1a1-aa76-4646-b438-166767b91479 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:12.183544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 574/1154] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:12.188692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f2b8-19d4-4797-845e-335d671c0fef None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:12.189114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f2b8-19d4-4797-845e-335d671c0fef None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:12.189251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f2b8-19d4-4797-845e-335d671c0fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:12.206198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f196f2b8-19d4-4797-845e-335d671c0fef None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:12.207372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f196f2b8-19d4-4797-845e-335d671c0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:12.235086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:12.273764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 581/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:06:12.297267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79c1a1-aa76-4646-b438-166767b91479 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:12.300114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:12.395853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79c1a1-aa76-4646-b438-166767b91479 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:12.428257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a6498-af64-4835-9728-877ff5d9392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:12.429052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a6498-af64-4835-9728-877ff5d9392e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:12.429335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a6498-af64-4835-9728-877ff5d9392e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:12.429607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a6498-af64-4835-9728-877ff5d9392e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:12.439853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a6498-af64-4835-9728-877ff5d9392e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-008a6498-af64-4835-9728-877ff5d9392e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:06:12.447398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:06:12.448539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:06:12.449414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 575/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:06:12.454361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f2b8-19d4-4797-845e-335d671c0fef None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:12.547944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f2b8-19d4-4797-845e-335d671c0fef None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:12.579869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe19ef4-e589-47b8-bbe0-59a10c4fb0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:12.580550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe19ef4-e589-47b8-bbe0-59a10c4fb0ca None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:12.580832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe19ef4-e589-47b8-bbe0-59a10c4fb0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:12.581103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe19ef4-e589-47b8-bbe0-59a10c4fb0ca None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:12.581822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe19ef4-e589-47b8-bbe0-59a10c4fb0ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:12.582124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe19ef4-e589-47b8-bbe0-59a10c4fb0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:12.583469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe19ef4-e589-47b8-bbe0-59a10c4fb0ca None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:12.591394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 582/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:06:12.596928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a6498-af64-4835-9728-877ff5d9392e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:12.656356 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:12.692960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a6498-af64-4835-9728-877ff5d9392e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:12.725623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0387a-3c44-4004-aa77-aae2592864b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:12.726458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0387a-3c44-4004-aa77-aae2592864b1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:12.726734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0387a-3c44-4004-aa77-aae2592864b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:12.727004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0387a-3c44-4004-aa77-aae2592864b1 None admin] PATH_INFO: `/v3/users/47d849d8cac44f5ca9716f8c83cede9c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:12.728779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0387a-3c44-4004-aa77-aae2592864b1 None admin] RBAC: Authorizing `identity:get_user(user_id=47d849d8cac44f5ca9716f8c83cede9c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:12.730203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0387a-3c44-4004-aa77-aae2592864b1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:12.731772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 576/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:06:12 2022] GET /identity/v3/users/47d849d8cac44f5ca9716f8c83cede9c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:12.737277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe19ef4-e589-47b8-bbe0-59a10c4fb0ca None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:12.764333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:12.833489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe19ef4-e589-47b8-bbe0-59a10c4fb0ca None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:12.867103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a677c2c-aaa8-4b4a-9398-cba5b7915b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:12.867743 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a677c2c-aaa8-4b4a-9398-cba5b7915b34 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:12.868048 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a677c2c-aaa8-4b4a-9398-cba5b7915b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:12.868350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a677c2c-aaa8-4b4a-9398-cba5b7915b34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:12.932420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a677c2c-aaa8-4b4a-9398-cba5b7915b34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:12.933849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a677c2c-aaa8-4b4a-9398-cba5b7915b34 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:12.958885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:13.028635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 583/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:06:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 03:06:13.034575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0387a-3c44-4004-aa77-aae2592864b1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:13.129055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0387a-3c44-4004-aa77-aae2592864b1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:13.156821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:13.162570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7bfb0-ac34-4d44-ab08-e19db669b008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:13.163429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7bfb0-ac34-4d44-ab08-e19db669b008 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:13.163716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7bfb0-ac34-4d44-ab08-e19db669b008 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:13.163995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7bfb0-ac34-4d44-ab08-e19db669b008 None admin] PATH_INFO: `/v3/projects/5c2f9989a7224effb0f64aced0b8e7d7` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:13.165205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7bfb0-ac34-4d44-ab08-e19db669b008 None admin] RBAC: Authorizing `identity:get_project(project_id=5c2f9989a7224effb0f64aced0b8e7d7)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:13.166664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7bfb0-ac34-4d44-ab08-e19db669b008 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:13.168375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 577/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:06:13 2022] GET /identity/v3/projects/5c2f9989a7224effb0f64aced0b8e7d7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:13.174336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a677c2c-aaa8-4b4a-9398-cba5b7915b34 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:13.269111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a677c2c-aaa8-4b4a-9398-cba5b7915b34 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:13.294037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:13.301480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cd0ef-3d20-41ee-8d31-b46f35df3c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:13.302945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cd0ef-3d20-41ee-8d31-b46f35df3c04 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:13.302945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cd0ef-3d20-41ee-8d31-b46f35df3c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:13.302945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cd0ef-3d20-41ee-8d31-b46f35df3c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:13.303448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cd0ef-3d20-41ee-8d31-b46f35df3c04 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=5c2f9989a7224effb0f64aced0b8e7d7, user.id=47d849d8cac44f5ca9716f8c83cede9c) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:13.303763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cd0ef-3d20-41ee-8d31-b46f35df3c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:13.305185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cd0ef-3d20-41ee-8d31-b46f35df3c04 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:13.310770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 584/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:06:13 2022] GET /identity/v3/role_assignments?user.id=47d849d8cac44f5ca9716f8c83cede9c&scope.project.id=5c2f9989a7224effb0f64aced0b8e7d7&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:15.483839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357836e4-3903-4860-964b-82e2b764e8f2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:15.484398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357836e4-3903-4860-964b-82e2b764e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:15.484492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357836e4-3903-4860-964b-82e2b764e8f2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:15.485811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 578/1162] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:15.491324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674ec46-245b-4be9-a646-cf6b7051f6f9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:15.491733 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674ec46-245b-4be9-a646-cf6b7051f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:15.491873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674ec46-245b-4be9-a646-cf6b7051f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:15.508128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d674ec46-245b-4be9-a646-cf6b7051f6f9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:15.509853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d674ec46-245b-4be9-a646-cf6b7051f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:15.572873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 585/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:15.595475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357836e4-3903-4860-964b-82e2b764e8f2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:15.693432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357836e4-3903-4860-964b-82e2b764e8f2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:15.726182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49e22e-c062-4a85-9e12-d652d0163650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:15.726807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49e22e-c062-4a85-9e12-d652d0163650 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:15.727095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49e22e-c062-4a85-9e12-d652d0163650 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:15.727376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49e22e-c062-4a85-9e12-d652d0163650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:15.790438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:15.793833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49e22e-c062-4a85-9e12-d652d0163650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:15.795294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49e22e-c062-4a85-9e12-d652d0163650 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:15.890467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 579/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:06:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:06:15.896436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674ec46-245b-4be9-a646-cf6b7051f6f9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:15.988984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674ec46-245b-4be9-a646-cf6b7051f6f9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:16.011124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:16.021909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee310c-1aaf-41af-bc91-a2d9bf080691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:16.024611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee310c-1aaf-41af-bc91-a2d9bf080691 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:16.024611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee310c-1aaf-41af-bc91-a2d9bf080691 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:16.024611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee310c-1aaf-41af-bc91-a2d9bf080691 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:16.029913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee310c-1aaf-41af-bc91-a2d9bf080691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:16.031350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee310c-1aaf-41af-bc91-a2d9bf080691 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ffee310c-1aaf-41af-bc91-a2d9bf080691 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:06:16.046237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:06:16.047553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:06:16.048631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 586/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:06:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:06:16.053104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49e22e-c062-4a85-9e12-d652d0163650 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:16.144878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:16.148549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49e22e-c062-4a85-9e12-d652d0163650 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:16.181815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11af65-3136-46f0-be0f-8e9c7282a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:16.182546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11af65-3136-46f0-be0f-8e9c7282a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:16.182833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11af65-3136-46f0-be0f-8e9c7282a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:16.183110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11af65-3136-46f0-be0f-8e9c7282a0e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:16.183825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11af65-3136-46f0-be0f-8e9c7282a0e6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:16.184134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11af65-3136-46f0-be0f-8e9c7282a0e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:16.185528 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11af65-3136-46f0-be0f-8e9c7282a0e6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:16.192411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 580/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Thu May 26 03:06:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:18.329438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba6653-a404-4e9c-86dc-13db06f3fe38 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:18.330020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba6653-a404-4e9c-86dc-13db06f3fe38 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:18.330020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba6653-a404-4e9c-86dc-13db06f3fe38 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:18.331368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 587/1167] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:18.337556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f8bf0-4f12-42c6-b16b-5682b6b95a96 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:18.337996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f8bf0-4f12-42c6-b16b-5682b6b95a96 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:18.338096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f8bf0-4f12-42c6-b16b-5682b6b95a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:18.354329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-796f8bf0-4f12-42c6-b16b-5682b6b95a96 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:18.355493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-796f8bf0-4f12-42c6-b16b-5682b6b95a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:18.419499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 581/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:18.441683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba6653-a404-4e9c-86dc-13db06f3fe38 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:18.540879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba6653-a404-4e9c-86dc-13db06f3fe38 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:18.573734 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798eaae-a204-41aa-adcc-08e9c6f6c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:18.574380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798eaae-a204-41aa-adcc-08e9c6f6c1f2 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:18.574666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798eaae-a204-41aa-adcc-08e9c6f6c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:18.574947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798eaae-a204-41aa-adcc-08e9c6f6c1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:18.575673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798eaae-a204-41aa-adcc-08e9c6f6c1f2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:18.577045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798eaae-a204-41aa-adcc-08e9c6f6c1f2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:18.652492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 588/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Thu May 26 03:06:18 2022] POST /identity/v3/domains => generated 267 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:06:20.845435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8318b-c5fb-4449-8a58-75aca53e9e98 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:20.845908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8318b-c5fb-4449-8a58-75aca53e9e98 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:20.846017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8318b-c5fb-4449-8a58-75aca53e9e98 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:20.847354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 582/1170] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:20.853124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37110d-3322-4fed-9ad3-99e9b9e40512 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:20.853507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37110d-3322-4fed-9ad3-99e9b9e40512 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:20.853680 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37110d-3322-4fed-9ad3-99e9b9e40512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:20.870602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6a37110d-3322-4fed-9ad3-99e9b9e40512 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:20.871771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6a37110d-3322-4fed-9ad3-99e9b9e40512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:20.905833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:20.935842 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 589/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:20.960785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8318b-c5fb-4449-8a58-75aca53e9e98 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:21.049248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:21.066472 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8318b-c5fb-4449-8a58-75aca53e9e98 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:21.091564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722076f5-b4de-40a8-909f-4854250e301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:21.092429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722076f5-b4de-40a8-909f-4854250e301d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:21.092712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722076f5-b4de-40a8-909f-4854250e301d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:21.092987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722076f5-b4de-40a8-909f-4854250e301d None admin] PATH_INFO: `/v3/domains/9143299ad7534921b1d4f7b1fb27e336` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:21.103441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722076f5-b4de-40a8-909f-4854250e301d None admin] RBAC: Authorizing `identity:get_domain(domain_id=9143299ad7534921b1d4f7b1fb27e336)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:21.104924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722076f5-b4de-40a8-909f-4854250e301d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:21.106506 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 583/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Thu May 26 03:06:20 2022] GET /identity/v3/domains/9143299ad7534921b1d4f7b1fb27e336 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:21.112265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37110d-3322-4fed-9ad3-99e9b9e40512 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:21.205211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37110d-3322-4fed-9ad3-99e9b9e40512 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:21.237891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48428c-04dd-4ec1-9b74-06f5692dcb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:21.238530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48428c-04dd-4ec1-9b74-06f5692dcb67 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:21.238812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48428c-04dd-4ec1-9b74-06f5692dcb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:21.239087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48428c-04dd-4ec1-9b74-06f5692dcb67 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:21.239774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48428c-04dd-4ec1-9b74-06f5692dcb67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:21.241218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48428c-04dd-4ec1-9b74-06f5692dcb67 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:21.321083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 590/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:06:21 2022] POST /identity/v3/projects => generated 361 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:06:23.520486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0535b-afd4-4440-8c98-26c706f7a968 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:23.521022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0535b-afd4-4440-8c98-26c706f7a968 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:23.521022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0535b-afd4-4440-8c98-26c706f7a968 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:23.522397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 584/1174] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:23.528258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc5dc-b076-4b30-b740-bcccb2902c1b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:23.528666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc5dc-b076-4b30-b740-bcccb2902c1b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:23.528852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc5dc-b076-4b30-b740-bcccb2902c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:23.545269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-01abc5dc-b076-4b30-b740-bcccb2902c1b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:23.546462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-01abc5dc-b076-4b30-b740-bcccb2902c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:23.563222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:23.611017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 591/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:23.635613 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0535b-afd4-4440-8c98-26c706f7a968 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:23.736667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0535b-afd4-4440-8c98-26c706f7a968 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:23.768841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c87d5-f5be-4994-8f79-9788050068e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:23.769679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c87d5-f5be-4994-8f79-9788050068e7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:23.769957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c87d5-f5be-4994-8f79-9788050068e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:23.770230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c87d5-f5be-4994-8f79-9788050068e7 None admin] PATH_INFO: `/v3/domains/9143299ad7534921b1d4f7b1fb27e336` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:23.771427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c87d5-f5be-4994-8f79-9788050068e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9143299ad7534921b1d4f7b1fb27e336)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:23.772836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c87d5-f5be-4994-8f79-9788050068e7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:23.774433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 585/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Thu May 26 03:06:23 2022] GET /identity/v3/domains/9143299ad7534921b1d4f7b1fb27e336 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:23.780509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abc5dc-b076-4b30-b740-bcccb2902c1b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:23.875167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abc5dc-b076-4b30-b740-bcccb2902c1b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:23.908072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c1593-d7de-4ee3-a935-82faf5dc9b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:23.908755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c1593-d7de-4ee3-a935-82faf5dc9b20 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:23.909037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c1593-d7de-4ee3-a935-82faf5dc9b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:23.909308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c1593-d7de-4ee3-a935-82faf5dc9b20 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:23.910008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c1593-d7de-4ee3-a935-82faf5dc9b20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:23.911422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c1593-d7de-4ee3-a935-82faf5dc9b20 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:23.970909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 592/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:06:23 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:06:26.159683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70912b82-064c-4306-a5cc-cb40c2ee375a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:26.160201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70912b82-064c-4306-a5cc-cb40c2ee375a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:26.160201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70912b82-064c-4306-a5cc-cb40c2ee375a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:26.161647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 586/1178] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:26.166887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fd8ae-a8e9-4838-8ce1-bf46a1016ccb None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:26.167276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fd8ae-a8e9-4838-8ce1-bf46a1016ccb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:26.167440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fd8ae-a8e9-4838-8ce1-bf46a1016ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:26.184058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f32fd8ae-a8e9-4838-8ce1-bf46a1016ccb None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:26.185256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f32fd8ae-a8e9-4838-8ce1-bf46a1016ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:26.187881 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:26.250266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 593/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:26.273365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70912b82-064c-4306-a5cc-cb40c2ee375a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:26.294277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:26.371665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70912b82-064c-4306-a5cc-cb40c2ee375a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:26.403633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d28f5-f977-4b40-80cd-59ba5c618839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:26.404411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d28f5-f977-4b40-80cd-59ba5c618839 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:26.404693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d28f5-f977-4b40-80cd-59ba5c618839 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:26.404964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d28f5-f977-4b40-80cd-59ba5c618839 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:26.414599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d28f5-f977-4b40-80cd-59ba5c618839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-429d28f5-f977-4b40-80cd-59ba5c618839 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:06:26.422252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:06:26.423442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:06:26.424597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 587/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:06:26.429312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fd8ae-a8e9-4838-8ce1-bf46a1016ccb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:26.525542 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fd8ae-a8e9-4838-8ce1-bf46a1016ccb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:26.558846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fec6c-0ab2-4932-b79c-d03182175c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:26.559500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fec6c-0ab2-4932-b79c-d03182175c22 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:26.559788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fec6c-0ab2-4932-b79c-d03182175c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:26.560068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fec6c-0ab2-4932-b79c-d03182175c22 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:26.560839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fec6c-0ab2-4932-b79c-d03182175c22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:26.561150 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fec6c-0ab2-4932-b79c-d03182175c22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:26.562519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fec6c-0ab2-4932-b79c-d03182175c22 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:26.570246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 594/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:26.575661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d28f5-f977-4b40-80cd-59ba5c618839 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:26.654108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:26.672829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d28f5-f977-4b40-80cd-59ba5c618839 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:26.705527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c64ce6-f485-40a4-921b-f32bffa194d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:26.706379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c64ce6-f485-40a4-921b-f32bffa194d2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:26.706664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c64ce6-f485-40a4-921b-f32bffa194d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:26.706943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c64ce6-f485-40a4-921b-f32bffa194d2 None admin] PATH_INFO: `/v3/users/416d123dd689487ca60fe460f7cf6bc1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:26.719786 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c64ce6-f485-40a4-921b-f32bffa194d2 None admin] RBAC: Authorizing `identity:get_user(user_id=416d123dd689487ca60fe460f7cf6bc1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:26.721254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c64ce6-f485-40a4-921b-f32bffa194d2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:26.722869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 588/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:06:26 2022] GET /identity/v3/users/416d123dd689487ca60fe460f7cf6bc1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:26.728929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fec6c-0ab2-4932-b79c-d03182175c22 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:26.731720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:26.826092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fec6c-0ab2-4932-b79c-d03182175c22 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:26.858548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b617848-d012-4194-96cd-2443801ff1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:26.859189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b617848-d012-4194-96cd-2443801ff1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:26.859476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b617848-d012-4194-96cd-2443801ff1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:26.859753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b617848-d012-4194-96cd-2443801ff1d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:26.925525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b617848-d012-4194-96cd-2443801ff1d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:26.926922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b617848-d012-4194-96cd-2443801ff1d8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:26.928848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:27.022087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 595/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:06:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:06:27.028502 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c64ce6-f485-40a4-921b-f32bffa194d2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:27.123694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c64ce6-f485-40a4-921b-f32bffa194d2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:27.156201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a428d-d47d-44ba-ae8a-1aaad552e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:27.157076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a428d-d47d-44ba-ae8a-1aaad552e590 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:27.157364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a428d-d47d-44ba-ae8a-1aaad552e590 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:27.157645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a428d-d47d-44ba-ae8a-1aaad552e590 None admin] PATH_INFO: `/v3/projects/d96b91771e7b476dbb8fa17a9be13148` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:27.158807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a428d-d47d-44ba-ae8a-1aaad552e590 None admin] RBAC: Authorizing `identity:get_project(project_id=d96b91771e7b476dbb8fa17a9be13148)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:27.160242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a428d-d47d-44ba-ae8a-1aaad552e590 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:27.161945 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 589/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:06:27 2022] GET /identity/v3/projects/d96b91771e7b476dbb8fa17a9be13148 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:27.168399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b617848-d012-4194-96cd-2443801ff1d8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:27.264162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b617848-d012-4194-96cd-2443801ff1d8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:27.265692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:27.297291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396bce-7f4f-4caa-8277-7ed7eeb5cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:27.297929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396bce-7f4f-4caa-8277-7ed7eeb5cf45 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:27.298214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396bce-7f4f-4caa-8277-7ed7eeb5cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:27.298493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396bce-7f4f-4caa-8277-7ed7eeb5cf45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:27.299305 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396bce-7f4f-4caa-8277-7ed7eeb5cf45 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=d96b91771e7b476dbb8fa17a9be13148, user.id=416d123dd689487ca60fe460f7cf6bc1) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:27.299619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396bce-7f4f-4caa-8277-7ed7eeb5cf45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:27.301059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396bce-7f4f-4caa-8277-7ed7eeb5cf45 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:27.306665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 596/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:06:27 2022] GET /identity/v3/role_assignments?user.id=416d123dd689487ca60fe460f7cf6bc1&scope.project.id=d96b91771e7b476dbb8fa17a9be13148&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:29.438741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1acb85-d34f-4946-8d91-08885dbbd767 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:29.439268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1acb85-d34f-4946-8d91-08885dbbd767 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:29.439381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1acb85-d34f-4946-8d91-08885dbbd767 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:29.440710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 590/1186] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:29.446104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac551ac4-8420-4be0-bfa8-71aafb587020 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:29.446546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac551ac4-8420-4be0-bfa8-71aafb587020 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:29.446664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac551ac4-8420-4be0-bfa8-71aafb587020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:29.463854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ac551ac4-8420-4be0-bfa8-71aafb587020 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:29.465068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ac551ac4-8420-4be0-bfa8-71aafb587020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:29.529888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 597/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:29.552488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1acb85-d34f-4946-8d91-08885dbbd767 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:29.561177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:29.652664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1acb85-d34f-4946-8d91-08885dbbd767 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:29.684478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2070-adb5-4522-9b51-43ee5fdc4514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:29.685254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2070-adb5-4522-9b51-43ee5fdc4514 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:29.685537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2070-adb5-4522-9b51-43ee5fdc4514 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:29.685811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2070-adb5-4522-9b51-43ee5fdc4514 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:29.695543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c2070-adb5-4522-9b51-43ee5fdc4514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-950c2070-adb5-4522-9b51-43ee5fdc4514 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:06:29.703635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:06:29.704772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:06:29.705781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 591/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:06:29.710928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac551ac4-8420-4be0-bfa8-71aafb587020 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:29.801277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:29.806793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac551ac4-8420-4be0-bfa8-71aafb587020 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:29.840638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f52954-e7fa-465c-8d57-09547e9b0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:29.841297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f52954-e7fa-465c-8d57-09547e9b0952 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:29.841610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f52954-e7fa-465c-8d57-09547e9b0952 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:29.841917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f52954-e7fa-465c-8d57-09547e9b0952 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:29.842649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f52954-e7fa-465c-8d57-09547e9b0952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:29.842956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f52954-e7fa-465c-8d57-09547e9b0952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:29.844301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f52954-e7fa-465c-8d57-09547e9b0952 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:29.852177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 598/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:29.858030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2070-adb5-4522-9b51-43ee5fdc4514 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:29.921517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:29.955912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2070-adb5-4522-9b51-43ee5fdc4514 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:29.987991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cb25e-64f9-4cf1-bbdf-4d98b5d6c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:29.988867 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cb25e-64f9-4cf1-bbdf-4d98b5d6c368 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:29.989152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cb25e-64f9-4cf1-bbdf-4d98b5d6c368 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:29.989429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cb25e-64f9-4cf1-bbdf-4d98b5d6c368 None admin] PATH_INFO: `/v3/users/416d123dd689487ca60fe460f7cf6bc1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:29.990599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cb25e-64f9-4cf1-bbdf-4d98b5d6c368 None admin] RBAC: Authorizing `identity:get_user(user_id=416d123dd689487ca60fe460f7cf6bc1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:29.992048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cb25e-64f9-4cf1-bbdf-4d98b5d6c368 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:29.994184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 592/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:06:29 2022] GET /identity/v3/users/416d123dd689487ca60fe460f7cf6bc1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:29.999645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f52954-e7fa-465c-8d57-09547e9b0952 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:30.094515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f52954-e7fa-465c-8d57-09547e9b0952 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:30.126180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8e14f-1bf0-4bd8-8abe-3e174f4c8fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:30.127003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8e14f-1bf0-4bd8-8abe-3e174f4c8fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:30.127279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8e14f-1bf0-4bd8-8abe-3e174f4c8fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:30.127549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8e14f-1bf0-4bd8-8abe-3e174f4c8fa3 None admin] PATH_INFO: `/v3/projects/d96b91771e7b476dbb8fa17a9be13148` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:30.128707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8e14f-1bf0-4bd8-8abe-3e174f4c8fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=d96b91771e7b476dbb8fa17a9be13148)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:30.130112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8e14f-1bf0-4bd8-8abe-3e174f4c8fa3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:30.131734 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 599/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:06:29 2022] GET /identity/v3/projects/d96b91771e7b476dbb8fa17a9be13148 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:30.138126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cb25e-64f9-4cf1-bbdf-4d98b5d6c368 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:30.233172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cb25e-64f9-4cf1-bbdf-4d98b5d6c368 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:30.265893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9205-c8e2-457d-88a3-a08d7642b144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:30.266758 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9205-c8e2-457d-88a3-a08d7642b144 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:30.267041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9205-c8e2-457d-88a3-a08d7642b144 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:30.267318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9205-c8e2-457d-88a3-a08d7642b144 None admin] PATH_INFO: `/v3/projects/d96b91771e7b476dbb8fa17a9be13148/users/416d123dd689487ca60fe460f7cf6bc1/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:30.269276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9205-c8e2-457d-88a3-a08d7642b144 None admin] RBAC: Authorizing `identity:create_grant(project_id=d96b91771e7b476dbb8fa17a9be13148, user_id=416d123dd689487ca60fe460f7cf6bc1, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:30.270705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9205-c8e2-457d-88a3-a08d7642b144 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:30.272883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:30.337202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 593/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:06:30 2022] PUT /identity/v3/projects/d96b91771e7b476dbb8fa17a9be13148/users/416d123dd689487ca60fe460f7cf6bc1/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:06:32.484108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729a4ab-1388-4575-a565-ffddecfdc6bb None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:32.484692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729a4ab-1388-4575-a565-ffddecfdc6bb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:32.484692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729a4ab-1388-4575-a565-ffddecfdc6bb None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:32.486064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 600/1193] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:06:32.491172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65da20-3e3b-4263-922a-3e9ca0a88cba None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:32.491587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65da20-3e3b-4263-922a-3e9ca0a88cba None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:32.491736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65da20-3e3b-4263-922a-3e9ca0a88cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:32.508651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7e65da20-3e3b-4263-922a-3e9ca0a88cba None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:06:32.510371 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7e65da20-3e3b-4263-922a-3e9ca0a88cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:06:32.573655 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 594/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:06:32.596939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729a4ab-1388-4575-a565-ffddecfdc6bb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:32.625004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:32.697930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729a4ab-1388-4575-a565-ffddecfdc6bb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:32.730877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985c17f-c291-4514-bcf1-0f7797bcc912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:32.731651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985c17f-c291-4514-bcf1-0f7797bcc912 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:32.731934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985c17f-c291-4514-bcf1-0f7797bcc912 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:32.732213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985c17f-c291-4514-bcf1-0f7797bcc912 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:32.742044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985c17f-c291-4514-bcf1-0f7797bcc912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a985c17f-c291-4514-bcf1-0f7797bcc912 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:06:32.750374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:06:32.751552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:06:32.752592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 601/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:06:32.757477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65da20-3e3b-4263-922a-3e9ca0a88cba None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:32.851479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65da20-3e3b-4263-922a-3e9ca0a88cba None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:32.874547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:32.884678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07219f-f922-400d-b8ee-62cda72c34d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:32.885337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07219f-f922-400d-b8ee-62cda72c34d1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:32.885623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07219f-f922-400d-b8ee-62cda72c34d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:32.885899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07219f-f922-400d-b8ee-62cda72c34d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:32.886639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07219f-f922-400d-b8ee-62cda72c34d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:32.886946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07219f-f922-400d-b8ee-62cda72c34d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:32.888332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07219f-f922-400d-b8ee-62cda72c34d1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:32.895982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 595/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:32.902556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985c17f-c291-4514-bcf1-0f7797bcc912 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:32.986178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:33.000391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985c17f-c291-4514-bcf1-0f7797bcc912 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:33.033431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045c20c-56d5-4bec-9b48-8b63b506eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:33.034285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045c20c-56d5-4bec-9b48-8b63b506eec5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:33.034570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045c20c-56d5-4bec-9b48-8b63b506eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:33.034845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045c20c-56d5-4bec-9b48-8b63b506eec5 None admin] PATH_INFO: `/v3/users/416d123dd689487ca60fe460f7cf6bc1` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:33.036007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045c20c-56d5-4bec-9b48-8b63b506eec5 None admin] RBAC: Authorizing `identity:get_user(user_id=416d123dd689487ca60fe460f7cf6bc1)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:33.037483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045c20c-56d5-4bec-9b48-8b63b506eec5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:33.039065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 602/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu May 26 03:06:32 2022] GET /identity/v3/users/416d123dd689487ca60fe460f7cf6bc1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:33.045243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07219f-f922-400d-b8ee-62cda72c34d1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:33.140701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07219f-f922-400d-b8ee-62cda72c34d1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:33.173744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932aa5a-ac53-4d9b-af9f-39f30c5a240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:33.174383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932aa5a-ac53-4d9b-af9f-39f30c5a240f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:33.174665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932aa5a-ac53-4d9b-af9f-39f30c5a240f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:33.174937 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932aa5a-ac53-4d9b-af9f-39f30c5a240f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:33.227346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:33.240287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932aa5a-ac53-4d9b-af9f-39f30c5a240f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:33.241777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932aa5a-ac53-4d9b-af9f-39f30c5a240f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:33.334859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 596/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:06:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:06:33.341569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045c20c-56d5-4bec-9b48-8b63b506eec5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:33.436995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045c20c-56d5-4bec-9b48-8b63b506eec5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:33.470282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61517e-5f05-4e10-8286-f4c8559ef17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:33.471125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61517e-5f05-4e10-8286-f4c8559ef17b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:33.471411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61517e-5f05-4e10-8286-f4c8559ef17b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:33.471687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61517e-5f05-4e10-8286-f4c8559ef17b None admin] PATH_INFO: `/v3/projects/d96b91771e7b476dbb8fa17a9be13148` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:33.472871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61517e-5f05-4e10-8286-f4c8559ef17b None admin] RBAC: Authorizing `identity:get_project(project_id=d96b91771e7b476dbb8fa17a9be13148)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:33.474276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61517e-5f05-4e10-8286-f4c8559ef17b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:33.475916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 603/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu May 26 03:06:33 2022] GET /identity/v3/projects/d96b91771e7b476dbb8fa17a9be13148 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:33.481780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932aa5a-ac53-4d9b-af9f-39f30c5a240f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:06:33.563799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:33.578054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932aa5a-ac53-4d9b-af9f-39f30c5a240f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:06:33.610737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b4f6a-82b3-4436-b7bc-26456ab0dcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:06:33.611318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b4f6a-82b3-4436-b7bc-26456ab0dcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:06:33.611598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b4f6a-82b3-4436-b7bc-26456ab0dcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:06:33.611872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b4f6a-82b3-4436-b7bc-26456ab0dcc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:06:33.612714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b4f6a-82b3-4436-b7bc-26456ab0dcc2 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=d96b91771e7b476dbb8fa17a9be13148, user.id=416d123dd689487ca60fe460f7cf6bc1) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:06:33.613022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b4f6a-82b3-4436-b7bc-26456ab0dcc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:06:33.614437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b4f6a-82b3-4436-b7bc-26456ab0dcc2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:06:33.620006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 597/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:06:33 2022] GET /identity/v3/role_assignments?user.id=416d123dd689487ca60fe460f7cf6bc1&scope.project.id=d96b91771e7b476dbb8fa17a9be13148&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:06:43.466262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:06:43.617444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=25 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:47.127951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93be7-2e84-4198-8660-e98ff5285109 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:47.128523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93be7-2e84-4198-8660-e98ff5285109 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:47.128523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea93be7-2e84-4198-8660-e98ff5285109 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:47.129815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 604/1201] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:07:47.135098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d98b7-a92b-4e6b-83e9-2bc5e94fdfb5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:47.135532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d98b7-a92b-4e6b-83e9-2bc5e94fdfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:47.135633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d98b7-a92b-4e6b-83e9-2bc5e94fdfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:47.152120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a71d98b7-a92b-4e6b-83e9-2bc5e94fdfb5 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:07:47.153317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a71d98b7-a92b-4e6b-83e9-2bc5e94fdfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:07:47.217844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 598/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:07:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:07:47.242020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea93be7-2e84-4198-8660-e98ff5285109 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:47.341592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea93be7-2e84-4198-8660-e98ff5285109 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:47.376180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e9408-bcc2-458d-be22-2579323a3ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:47.377006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e9408-bcc2-458d-be22-2579323a3ffd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:47.377289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e9408-bcc2-458d-be22-2579323a3ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:47.377567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e9408-bcc2-458d-be22-2579323a3ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:47.389835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e9408-bcc2-458d-be22-2579323a3ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:47.389835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e9408-bcc2-458d-be22-2579323a3ffd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e22e9408-bcc2-458d-be22-2579323a3ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:07:47.406832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:47.408069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:47.409113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:07:47.409113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:07:47.409113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:47.409113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:07:47.409113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 605/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:07:47.414117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d98b7-a92b-4e6b-83e9-2bc5e94fdfb5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:47.510601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d98b7-a92b-4e6b-83e9-2bc5e94fdfb5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:47.537981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:47.544253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2facb8-f015-4ac9-af3d-b7cbe22482c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:47.544936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2facb8-f015-4ac9-af3d-b7cbe22482c8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:47.545217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2facb8-f015-4ac9-af3d-b7cbe22482c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:47.545495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2facb8-f015-4ac9-af3d-b7cbe22482c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:47.546207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2facb8-f015-4ac9-af3d-b7cbe22482c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:47.546513 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2facb8-f015-4ac9-af3d-b7cbe22482c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:47.547881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2facb8-f015-4ac9-af3d-b7cbe22482c8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:47.558569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 599/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:47.564504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e9408-bcc2-458d-be22-2579323a3ffd None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:47.618361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:47.664599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e9408-bcc2-458d-be22-2579323a3ffd None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:47.698009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c78c74-d7ce-4bda-9100-80009840a4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:47.698726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c78c74-d7ce-4bda-9100-80009840a4d4 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:47.699053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c78c74-d7ce-4bda-9100-80009840a4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:47.699363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c78c74-d7ce-4bda-9100-80009840a4d4 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:47.700159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c78c74-d7ce-4bda-9100-80009840a4d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:47.701885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c78c74-d7ce-4bda-9100-80009840a4d4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:47.789767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 606/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Thu May 26 03:07:47 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:07:49.987236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a9697-1bf2-4f14-8a1d-c1c859396fe7 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:49.987840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a9697-1bf2-4f14-8a1d-c1c859396fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:49.987840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a9697-1bf2-4f14-8a1d-c1c859396fe7 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:49.989197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 600/1206] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:07:49.994553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62623616-e9e7-46c4-b4f1-67fbe8d4eb27 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:50.002759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62623616-e9e7-46c4-b4f1-67fbe8d4eb27 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:50.002759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62623616-e9e7-46c4-b4f1-67fbe8d4eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:50.012388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-62623616-e9e7-46c4-b4f1-67fbe8d4eb27 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:07:50.013605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-62623616-e9e7-46c4-b4f1-67fbe8d4eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:07:50.078476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 607/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:07:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:07:50.101986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a9697-1bf2-4f14-8a1d-c1c859396fe7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:50.201310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a9697-1bf2-4f14-8a1d-c1c859396fe7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:50.234501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9623c2a-a950-484c-a663-67040d45804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:50.235283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9623c2a-a950-484c-a663-67040d45804a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:50.235564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9623c2a-a950-484c-a663-67040d45804a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:50.235838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9623c2a-a950-484c-a663-67040d45804a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:50.245877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9623c2a-a950-484c-a663-67040d45804a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c9623c2a-a950-484c-a663-67040d45804a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:07:50.253489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:50.254679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:07:50.255983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 601/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:07:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:50.260584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62623616-e9e7-46c4-b4f1-67fbe8d4eb27 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:50.301140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:50.363072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62623616-e9e7-46c4-b4f1-67fbe8d4eb27 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:50.396489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd009af8-ddc5-46b8-941f-0f3c669f6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:50.397158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd009af8-ddc5-46b8-941f-0f3c669f6583 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:50.397440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd009af8-ddc5-46b8-941f-0f3c669f6583 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:50.397716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd009af8-ddc5-46b8-941f-0f3c669f6583 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:50.398449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd009af8-ddc5-46b8-941f-0f3c669f6583 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:50.398754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd009af8-ddc5-46b8-941f-0f3c669f6583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:50.400103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd009af8-ddc5-46b8-941f-0f3c669f6583 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:50.408447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 608/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:50.414285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9623c2a-a950-484c-a663-67040d45804a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:50.466223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:50.514516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9623c2a-a950-484c-a663-67040d45804a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:50.545943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b2eaa-8edc-465c-b006-16cc20af89e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:50.546726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b2eaa-8edc-465c-b006-16cc20af89e0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:50.547126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b2eaa-8edc-465c-b006-16cc20af89e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:50.547403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b2eaa-8edc-465c-b006-16cc20af89e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:50.558128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b2eaa-8edc-465c-b006-16cc20af89e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:50.559572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b2eaa-8edc-465c-b006-16cc20af89e0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-655b2eaa-8edc-465c-b006-16cc20af89e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:07:50.577789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:50.578877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:50.579984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:07:50.579984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:07:50.579984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:50.579984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:07:50.579984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 602/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:50.584814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd009af8-ddc5-46b8-941f-0f3c669f6583 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:50.681582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:50.685075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd009af8-ddc5-46b8-941f-0f3c669f6583 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:50.718139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82999d63-ee16-4506-a922-ea82f4698fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:50.718799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82999d63-ee16-4506-a922-ea82f4698fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:50.719091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82999d63-ee16-4506-a922-ea82f4698fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:50.719399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82999d63-ee16-4506-a922-ea82f4698fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:50.720154 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82999d63-ee16-4506-a922-ea82f4698fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:50.720739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82999d63-ee16-4506-a922-ea82f4698fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:50.722395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82999d63-ee16-4506-a922-ea82f4698fe0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:50.733832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 609/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:50.739600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b2eaa-8edc-465c-b006-16cc20af89e0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:50.840112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b2eaa-8edc-465c-b006-16cc20af89e0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:50.841624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:50.873478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4ecb3-c14c-4983-b9e7-e26eaa7f14e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:50.874265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4ecb3-c14c-4983-b9e7-e26eaa7f14e1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:50.874543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4ecb3-c14c-4983-b9e7-e26eaa7f14e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:50.874817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4ecb3-c14c-4983-b9e7-e26eaa7f14e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:50.881818 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4ecb3-c14c-4983-b9e7-e26eaa7f14e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:50.883247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4ecb3-c14c-4983-b9e7-e26eaa7f14e1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-78b4ecb3-c14c-4983-b9e7-e26eaa7f14e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:07:50.898918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:50.902191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:07:50.903403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 603/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:50.906134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82999d63-ee16-4506-a922-ea82f4698fe0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:51.004189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82999d63-ee16-4506-a922-ea82f4698fe0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:51.037504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43084c9-b766-4834-9e43-bb8be173eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:51.038169 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43084c9-b766-4834-9e43-bb8be173eee8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:51.038454 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43084c9-b766-4834-9e43-bb8be173eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:51.038730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43084c9-b766-4834-9e43-bb8be173eee8 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:51.039595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43084c9-b766-4834-9e43-bb8be173eee8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:51.039905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43084c9-b766-4834-9e43-bb8be173eee8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:51.041350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43084c9-b766-4834-9e43-bb8be173eee8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:51.059333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 610/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Thu May 26 03:07:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:51.065054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4ecb3-c14c-4983-b9e7-e26eaa7f14e1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:51.161717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4ecb3-c14c-4983-b9e7-e26eaa7f14e1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:51.195741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841287-c894-4d74-b8ba-26c75ee696cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:51.196392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841287-c894-4d74-b8ba-26c75ee696cc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:51.196675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841287-c894-4d74-b8ba-26c75ee696cc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:51.196949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841287-c894-4d74-b8ba-26c75ee696cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:51.225364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:51.262389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c841287-c894-4d74-b8ba-26c75ee696cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:51.263769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c841287-c894-4d74-b8ba-26c75ee696cc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:51.358067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 604/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:07:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:07:51.363906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43084c9-b766-4834-9e43-bb8be173eee8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:51.382615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:51.461719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43084c9-b766-4834-9e43-bb8be173eee8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:51.495276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f810c0-0a6c-4109-b291-5c3039d0a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:51.496146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f810c0-0a6c-4109-b291-5c3039d0a111 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:51.496463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f810c0-0a6c-4109-b291-5c3039d0a111 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:51.496742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f810c0-0a6c-4109-b291-5c3039d0a111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:51.506495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f810c0-0a6c-4109-b291-5c3039d0a111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:51.507950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f810c0-0a6c-4109-b291-5c3039d0a111 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e0f810c0-0a6c-4109-b291-5c3039d0a111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:07:51.525607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:51.527206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:51.528488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:07:51.528488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:07:51.528488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:51.528488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:07:51.528488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 611/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:51.533152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841287-c894-4d74-b8ba-26c75ee696cc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:51.593603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:51.631084 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841287-c894-4d74-b8ba-26c75ee696cc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:51.663636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613222c9-9daa-4dd5-9638-39ba78eb1df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:51.664289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613222c9-9daa-4dd5-9638-39ba78eb1df4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:51.664602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613222c9-9daa-4dd5-9638-39ba78eb1df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:51.664879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613222c9-9daa-4dd5-9638-39ba78eb1df4 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:51.665594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613222c9-9daa-4dd5-9638-39ba78eb1df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:51.665901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613222c9-9daa-4dd5-9638-39ba78eb1df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:51.667303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613222c9-9daa-4dd5-9638-39ba78eb1df4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:51.678882 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 605/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:51.684418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f810c0-0a6c-4109-b291-5c3039d0a111 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:51.752641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:51.783484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f810c0-0a6c-4109-b291-5c3039d0a111 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:51.816894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72079d6-7d26-475d-bb26-57f7f8a0da17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:51.817679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72079d6-7d26-475d-bb26-57f7f8a0da17 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:51.817961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72079d6-7d26-475d-bb26-57f7f8a0da17 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:51.818234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72079d6-7d26-475d-bb26-57f7f8a0da17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:51.825284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72079d6-7d26-475d-bb26-57f7f8a0da17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:51.826723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72079d6-7d26-475d-bb26-57f7f8a0da17 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e72079d6-7d26-475d-bb26-57f7f8a0da17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:07:51.842286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:51.843383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:51.844566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:07:51.844566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:07:51.844566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:07:51.844566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:07:51.844566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:07:51.844566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:07:51.844566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:07:51.844566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:07:51.844566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 612/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:51.849327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613222c9-9daa-4dd5-9638-39ba78eb1df4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:51.944754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613222c9-9daa-4dd5-9638-39ba78eb1df4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:51.967387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:51.978359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6678581-c15d-4515-a0f5-7393990f5a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:51.979006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6678581-c15d-4515-a0f5-7393990f5a42 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:51.979288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6678581-c15d-4515-a0f5-7393990f5a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:51.979591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6678581-c15d-4515-a0f5-7393990f5a42 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:51.980406 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6678581-c15d-4515-a0f5-7393990f5a42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:51.980717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6678581-c15d-4515-a0f5-7393990f5a42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:51.982148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6678581-c15d-4515-a0f5-7393990f5a42 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:51.993011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 606/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:51.999580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72079d6-7d26-475d-bb26-57f7f8a0da17 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:52.097371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72079d6-7d26-475d-bb26-57f7f8a0da17 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:52.125041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:52.130748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000498f-e744-4a6c-89b6-074ba6119b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:52.131403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000498f-e744-4a6c-89b6-074ba6119b9d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:52.131688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000498f-e744-4a6c-89b6-074ba6119b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:52.131964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000498f-e744-4a6c-89b6-074ba6119b9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:52.132846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000498f-e744-4a6c-89b6-074ba6119b9d None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=257d9a088fa04cd5af48d6e4fb8b2f0e) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:52.133159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000498f-e744-4a6c-89b6-074ba6119b9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:52.134574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000498f-e744-4a6c-89b6-074ba6119b9d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:52.140645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 613/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:07:51 2022] GET /identity/v3/role_assignments?user.id=257d9a088fa04cd5af48d6e4fb8b2f0e&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:54.280592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767d577-e3cd-42e5-a97b-9e9f78b7bf95 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:54.281141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767d577-e3cd-42e5-a97b-9e9f78b7bf95 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:54.281141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767d577-e3cd-42e5-a97b-9e9f78b7bf95 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:54.282516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 607/1220] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:07:54.287814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823edfc-1c53-44df-a108-0e7506c04e37 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:54.294087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823edfc-1c53-44df-a108-0e7506c04e37 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:54.294087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823edfc-1c53-44df-a108-0e7506c04e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:54.305668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0823edfc-1c53-44df-a108-0e7506c04e37 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:07:54.306863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0823edfc-1c53-44df-a108-0e7506c04e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:07:54.372691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 614/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:07:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:07:54.395303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767d577-e3cd-42e5-a97b-9e9f78b7bf95 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:54.496119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767d577-e3cd-42e5-a97b-9e9f78b7bf95 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:54.529746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45c261-31f1-44fa-961d-40365de10d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:54.530716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45c261-31f1-44fa-961d-40365de10d1c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:54.530952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45c261-31f1-44fa-961d-40365de10d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:54.531226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45c261-31f1-44fa-961d-40365de10d1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:54.541200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45c261-31f1-44fa-961d-40365de10d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-6c45c261-31f1-44fa-961d-40365de10d1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:07:54.549546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:54.550638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:07:54.551832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 608/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:54.556776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823edfc-1c53-44df-a108-0e7506c04e37 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:54.656222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823edfc-1c53-44df-a108-0e7506c04e37 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:54.678636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:54.688747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9989890-9da6-46bc-b732-7b223bfe46ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:54.689409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9989890-9da6-46bc-b732-7b223bfe46ef None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:54.689690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9989890-9da6-46bc-b732-7b223bfe46ef None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:54.689965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9989890-9da6-46bc-b732-7b223bfe46ef None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:54.690691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9989890-9da6-46bc-b732-7b223bfe46ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:54.690996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9989890-9da6-46bc-b732-7b223bfe46ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:54.692367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9989890-9da6-46bc-b732-7b223bfe46ef None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:54.700600 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 615/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:54.712465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45c261-31f1-44fa-961d-40365de10d1c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:54.749324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:54.803795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45c261-31f1-44fa-961d-40365de10d1c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:54.835835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357f6f-d5d7-4cb3-998d-8ac812d98571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:54.836912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357f6f-d5d7-4cb3-998d-8ac812d98571 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:54.837196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357f6f-d5d7-4cb3-998d-8ac812d98571 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:54.837474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357f6f-d5d7-4cb3-998d-8ac812d98571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:54.847964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357f6f-d5d7-4cb3-998d-8ac812d98571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:54.849441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357f6f-d5d7-4cb3-998d-8ac812d98571 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a6357f6f-d5d7-4cb3-998d-8ac812d98571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:07:54.867119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:54.868163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:54.869176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:07:54.869176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:07:54.869176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:54.869176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:07:54.869176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 609/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:54.874266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9989890-9da6-46bc-b732-7b223bfe46ef None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:54.974110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9989890-9da6-46bc-b732-7b223bfe46ef None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:55.007380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668e7c-a65b-47dd-9361-816fd6cdbb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:55.008038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668e7c-a65b-47dd-9361-816fd6cdbb31 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:55.008338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668e7c-a65b-47dd-9361-816fd6cdbb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:55.008631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668e7c-a65b-47dd-9361-816fd6cdbb31 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:55.009339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668e7c-a65b-47dd-9361-816fd6cdbb31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:55.009645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668e7c-a65b-47dd-9361-816fd6cdbb31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:55.011596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668e7c-a65b-47dd-9361-816fd6cdbb31 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:55.023755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 616/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:55.029501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357f6f-d5d7-4cb3-998d-8ac812d98571 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:55.123025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:55.129340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357f6f-d5d7-4cb3-998d-8ac812d98571 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:55.161764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adccb2-cd51-47b0-9e23-593a1246a712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:55.162555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adccb2-cd51-47b0-9e23-593a1246a712 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:55.162837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adccb2-cd51-47b0-9e23-593a1246a712 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:55.163111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adccb2-cd51-47b0-9e23-593a1246a712 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:55.170280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adccb2-cd51-47b0-9e23-593a1246a712 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:55.175434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adccb2-cd51-47b0-9e23-593a1246a712 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-30adccb2-cd51-47b0-9e23-593a1246a712 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:07:55.187120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:55.188202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:07:55.189372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 610/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:55.194145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668e7c-a65b-47dd-9361-816fd6cdbb31 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:55.241030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:55.292869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668e7c-a65b-47dd-9361-816fd6cdbb31 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:55.330846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61ebd9-a699-41c5-8bf2-78b16c82a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:55.331591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61ebd9-a699-41c5-8bf2-78b16c82a075 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:55.331873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61ebd9-a699-41c5-8bf2-78b16c82a075 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:55.332147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61ebd9-a699-41c5-8bf2-78b16c82a075 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:55.332993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61ebd9-a699-41c5-8bf2-78b16c82a075 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:55.333301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61ebd9-a699-41c5-8bf2-78b16c82a075 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:55.334698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61ebd9-a699-41c5-8bf2-78b16c82a075 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:55.351878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 617/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Thu May 26 03:07:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:55.358067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adccb2-cd51-47b0-9e23-593a1246a712 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:55.456454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adccb2-cd51-47b0-9e23-593a1246a712 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:55.488736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c955318-6c1b-4bfd-b8fa-1add2984901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:55.489960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c955318-6c1b-4bfd-b8fa-1add2984901a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:55.489960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c955318-6c1b-4bfd-b8fa-1add2984901a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:55.490131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c955318-6c1b-4bfd-b8fa-1add2984901a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:55.501354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c955318-6c1b-4bfd-b8fa-1add2984901a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:55.502817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c955318-6c1b-4bfd-b8fa-1add2984901a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4c955318-6c1b-4bfd-b8fa-1add2984901a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:07:55.519242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:55.520354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:55.521650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:07:55.521650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:07:55.521650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:55.521650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:07:55.521650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 611/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:55.526187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61ebd9-a699-41c5-8bf2-78b16c82a075 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:55.625762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61ebd9-a699-41c5-8bf2-78b16c82a075 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:55.628346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:55.658235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7396cb-192b-4cad-9c9a-5a7c9d61787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:55.658885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7396cb-192b-4cad-9c9a-5a7c9d61787e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:55.659163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7396cb-192b-4cad-9c9a-5a7c9d61787e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:55.659432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7396cb-192b-4cad-9c9a-5a7c9d61787e None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:55.660162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7396cb-192b-4cad-9c9a-5a7c9d61787e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:55.660503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7396cb-192b-4cad-9c9a-5a7c9d61787e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:55.661844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7396cb-192b-4cad-9c9a-5a7c9d61787e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:55.673126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 618/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:55.679033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c955318-6c1b-4bfd-b8fa-1add2984901a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:55.689108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:55.777759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c955318-6c1b-4bfd-b8fa-1add2984901a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:55.811793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dad22-9031-4528-aec5-b8c48cecb6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:55.813635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dad22-9031-4528-aec5-b8c48cecb6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:55.813929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dad22-9031-4528-aec5-b8c48cecb6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:55.814230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dad22-9031-4528-aec5-b8c48cecb6d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:55.820962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dad22-9031-4528-aec5-b8c48cecb6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:55.822504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dad22-9031-4528-aec5-b8c48cecb6d7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-656dad22-9031-4528-aec5-b8c48cecb6d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:07:55.836797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:55.837835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:55.839470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:07:55.839470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:07:55.839470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:07:55.839470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:07:55.839470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:07:55.839470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:07:55.839470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:07:55.839470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:07:55.839470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 612/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:55.844545 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7396cb-192b-4cad-9c9a-5a7c9d61787e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:55.942663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7396cb-192b-4cad-9c9a-5a7c9d61787e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:55.975335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e00c1-e289-4762-bc5c-7b4b89c10ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:55.976018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e00c1-e289-4762-bc5c-7b4b89c10ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:55.976299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e00c1-e289-4762-bc5c-7b4b89c10ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:55.976600 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e00c1-e289-4762-bc5c-7b4b89c10ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:55.977370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e00c1-e289-4762-bc5c-7b4b89c10ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:55.977682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e00c1-e289-4762-bc5c-7b4b89c10ae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:55.979093 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e00c1-e289-4762-bc5c-7b4b89c10ae6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:55.991518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 619/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:07:55.997651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dad22-9031-4528-aec5-b8c48cecb6d7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:56.061862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:56.094994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dad22-9031-4528-aec5-b8c48cecb6d7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:56.127974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa8d1f-023d-4bc1-b442-c5c043a4aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:56.128879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa8d1f-023d-4bc1-b442-c5c043a4aa03 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:56.129183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa8d1f-023d-4bc1-b442-c5c043a4aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:56.129441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa8d1f-023d-4bc1-b442-c5c043a4aa03 None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/257d9a088fa04cd5af48d6e4fb8b2f0e/roles/515757e98f5646209fb1eb39aa40ead4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:56.143742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa8d1f-023d-4bc1-b442-c5c043a4aa03 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=257d9a088fa04cd5af48d6e4fb8b2f0e, role_id=515757e98f5646209fb1eb39aa40ead4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:56.145224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa8d1f-023d-4bc1-b442-c5c043a4aa03 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:56.211692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 613/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:07:55 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/257d9a088fa04cd5af48d6e4fb8b2f0e/roles/515757e98f5646209fb1eb39aa40ead4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:07:58.408243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389b931-3193-4e20-948f-639b9b74f2b5 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:58.408845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389b931-3193-4e20-948f-639b9b74f2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:58.408845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389b931-3193-4e20-948f-639b9b74f2b5 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:58.410198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 620/1233] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:07:58.415366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce99893-a440-4bc2-9b8b-08c9052655da None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:58.415739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce99893-a440-4bc2-9b8b-08c9052655da None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:58.415926 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce99893-a440-4bc2-9b8b-08c9052655da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:58.433405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2ce99893-a440-4bc2-9b8b-08c9052655da None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:07:58.434727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2ce99893-a440-4bc2-9b8b-08c9052655da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:07:58.500392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 614/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:07:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:07:58.523504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389b931-3193-4e20-948f-639b9b74f2b5 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:58.549160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:58.623679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389b931-3193-4e20-948f-639b9b74f2b5 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:58.657103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679628f8-3a88-4760-bf75-8c68fe88bc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:58.657886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679628f8-3a88-4760-bf75-8c68fe88bc76 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:58.658168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679628f8-3a88-4760-bf75-8c68fe88bc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:58.664180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679628f8-3a88-4760-bf75-8c68fe88bc76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:58.668431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679628f8-3a88-4760-bf75-8c68fe88bc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-679628f8-3a88-4760-bf75-8c68fe88bc76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:07:58.676265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:58.677396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:07:58.678463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 621/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Thu May 26 03:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:07:58.683401 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce99893-a440-4bc2-9b8b-08c9052655da None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:58.729601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:58.780215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce99893-a440-4bc2-9b8b-08c9052655da None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:58.815320 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e69d77-3c2c-4a13-92ce-96f10814a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:58.815990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e69d77-3c2c-4a13-92ce-96f10814a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:58.816298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e69d77-3c2c-4a13-92ce-96f10814a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:58.816590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e69d77-3c2c-4a13-92ce-96f10814a1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:58.817337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e69d77-3c2c-4a13-92ce-96f10814a1a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:58.817633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e69d77-3c2c-4a13-92ce-96f10814a1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:58.819003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e69d77-3c2c-4a13-92ce-96f10814a1a8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:58.827614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 615/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Thu May 26 03:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:58.833399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679628f8-3a88-4760-bf75-8c68fe88bc76 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:58.915712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:58.930334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679628f8-3a88-4760-bf75-8c68fe88bc76 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:58.963608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ecfad-377e-4493-836b-d3917428bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:58.964468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ecfad-377e-4493-836b-d3917428bd1f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:58.964754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ecfad-377e-4493-836b-d3917428bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:58.969268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ecfad-377e-4493-836b-d3917428bd1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:58.974804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ecfad-377e-4493-836b-d3917428bd1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:58.976273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ecfad-377e-4493-836b-d3917428bd1f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-282ecfad-377e-4493-836b-d3917428bd1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:07:58.993493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:58.994623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:58.996089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:07:58.996089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:07:58.996089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:58.996089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:07:58.996089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 622/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:59.000979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e69d77-3c2c-4a13-92ce-96f10814a1a8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:59.098152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e69d77-3c2c-4a13-92ce-96f10814a1a8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:59.107220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:59.131087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1ff7-6fe8-48a0-906d-e96ceabfd8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:59.131736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1ff7-6fe8-48a0-906d-e96ceabfd8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:59.132019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1ff7-6fe8-48a0-906d-e96ceabfd8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:59.132295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1ff7-6fe8-48a0-906d-e96ceabfd8d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:59.133045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c1ff7-6fe8-48a0-906d-e96ceabfd8d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:59.133346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c1ff7-6fe8-48a0-906d-e96ceabfd8d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:59.137952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c1ff7-6fe8-48a0-906d-e96ceabfd8d5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:59.145871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 616/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:07:59.151452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ecfad-377e-4493-836b-d3917428bd1f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:59.249996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ecfad-377e-4493-836b-d3917428bd1f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:59.282456 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae93395-8eb6-4458-8ed6-08098cd91f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:59.283247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae93395-8eb6-4458-8ed6-08098cd91f8e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:59.283530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae93395-8eb6-4458-8ed6-08098cd91f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:59.283807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae93395-8eb6-4458-8ed6-08098cd91f8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:59.286666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:59.291466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae93395-8eb6-4458-8ed6-08098cd91f8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:59.293515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae93395-8eb6-4458-8ed6-08098cd91f8e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-cae93395-8eb6-4458-8ed6-08098cd91f8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:07:59.308586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:59.310282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:07:59.312074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 623/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:59.315641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1ff7-6fe8-48a0-906d-e96ceabfd8d5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:59.412251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1ff7-6fe8-48a0-906d-e96ceabfd8d5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:59.445676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93944170-6219-4524-926d-d23c87c89554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:59.446336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93944170-6219-4524-926d-d23c87c89554 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:59.446618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93944170-6219-4524-926d-d23c87c89554 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:59.446896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93944170-6219-4524-926d-d23c87c89554 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:59.447723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93944170-6219-4524-926d-d23c87c89554 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:07:59.448029 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93944170-6219-4524-926d-d23c87c89554 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:59.449482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93944170-6219-4524-926d-d23c87c89554 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:59.466048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 617/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Thu May 26 03:07:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:07:59.471746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae93395-8eb6-4458-8ed6-08098cd91f8e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:59.568886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae93395-8eb6-4458-8ed6-08098cd91f8e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:59.601707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d774081-613c-415d-8e11-787ac9323d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:59.602336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d774081-613c-415d-8e11-787ac9323d73 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:59.602703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d774081-613c-415d-8e11-787ac9323d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:59.602985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d774081-613c-415d-8e11-787ac9323d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:59.661580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:59.668667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d774081-613c-415d-8e11-787ac9323d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:59.670160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d774081-613c-415d-8e11-787ac9323d73 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:59.766000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 624/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:07:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:07:59.771990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93944170-6219-4524-926d-d23c87c89554 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:07:59.800665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:07:59.871757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93944170-6219-4524-926d-d23c87c89554 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:07:59.906198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcac7ca-b078-40eb-a8a9-9c4fe7fae575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:07:59.906987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcac7ca-b078-40eb-a8a9-9c4fe7fae575 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:07:59.907267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcac7ca-b078-40eb-a8a9-9c4fe7fae575 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:07:59.907565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcac7ca-b078-40eb-a8a9-9c4fe7fae575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:07:59.917702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcac7ca-b078-40eb-a8a9-9c4fe7fae575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:07:59.919203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcac7ca-b078-40eb-a8a9-9c4fe7fae575 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5bcac7ca-b078-40eb-a8a9-9c4fe7fae575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:07:59.936269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:07:59.937315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:07:59.938349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:07:59.938349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:07:59.938349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:07:59.938349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:07:59.938349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 618/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:07:59.943181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d774081-613c-415d-8e11-787ac9323d73 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:00.035375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:00.040942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d774081-613c-415d-8e11-787ac9323d73 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:00.075010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0422504-d879-4373-b06d-56c9459131f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:00.075656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0422504-d879-4373-b06d-56c9459131f1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:00.075943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0422504-d879-4373-b06d-56c9459131f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:00.076215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0422504-d879-4373-b06d-56c9459131f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:00.076951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0422504-d879-4373-b06d-56c9459131f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:00.077258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0422504-d879-4373-b06d-56c9459131f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:00.078618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0422504-d879-4373-b06d-56c9459131f1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:00.090714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 625/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:00.096403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcac7ca-b078-40eb-a8a9-9c4fe7fae575 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:00.172300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:00.191973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcac7ca-b078-40eb-a8a9-9c4fe7fae575 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:00.226387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54c9a5-f6e9-4f25-9413-3103944f7fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:00.227170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54c9a5-f6e9-4f25-9413-3103944f7fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:00.227453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54c9a5-f6e9-4f25-9413-3103944f7fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:00.227785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54c9a5-f6e9-4f25-9413-3103944f7fb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:00.234379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54c9a5-f6e9-4f25-9413-3103944f7fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:00.235817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54c9a5-f6e9-4f25-9413-3103944f7fb3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-8f54c9a5-f6e9-4f25-9413-3103944f7fb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:08:00.249885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:00.250879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:00.251987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:08:00.251987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:08:00.251987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:08:00.251987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:08:00.251987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:08:00.251987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:08:00.251987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:08:00.251987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:00.251987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 619/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:00.257029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0422504-d879-4373-b06d-56c9459131f1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:00.354963 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0422504-d879-4373-b06d-56c9459131f1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:00.387953 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acc9a9-a8c2-4c16-9814-2695fe438fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:00.388629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc9a9-a8c2-4c16-9814-2695fe438fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:00.388914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc9a9-a8c2-4c16-9814-2695fe438fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:00.389194 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc9a9-a8c2-4c16-9814-2695fe438fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:00.389971 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acc9a9-a8c2-4c16-9814-2695fe438fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:00.390284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acc9a9-a8c2-4c16-9814-2695fe438fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:00.391704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acc9a9-a8c2-4c16-9814-2695fe438fc2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:00.403391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 626/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:00.409666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54c9a5-f6e9-4f25-9413-3103944f7fb3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:00.512429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54c9a5-f6e9-4f25-9413-3103944f7fb3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:00.545443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3414be-491f-43c9-a169-b0b562a1cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:00.546130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3414be-491f-43c9-a169-b0b562a1cd5a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:00.546442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3414be-491f-43c9-a169-b0b562a1cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:00.546712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3414be-491f-43c9-a169-b0b562a1cd5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:00.547657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3414be-491f-43c9-a169-b0b562a1cd5a None admin] RBAC: Adding query filter params (role.id=515757e98f5646209fb1eb39aa40ead4, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=257d9a088fa04cd5af48d6e4fb8b2f0e) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:00.547972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3414be-491f-43c9-a169-b0b562a1cd5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:00.549437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3414be-491f-43c9-a169-b0b562a1cd5a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:00.555113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 620/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:08:00 2022] GET /identity/v3/role_assignments?user.id=257d9a088fa04cd5af48d6e4fb8b2f0e&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=515757e98f5646209fb1eb39aa40ead4 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:02.780453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723961b-f924-4967-8826-bb8d3ad3dd0a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:02.780983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723961b-f924-4967-8826-bb8d3ad3dd0a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:02.780983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723961b-f924-4967-8826-bb8d3ad3dd0a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:02.782349 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 627/1247] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:08:02.787785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f1531-1348-420c-89b7-1e869cd5e018 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:02.788188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f1531-1348-420c-89b7-1e869cd5e018 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:02.788430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f1531-1348-420c-89b7-1e869cd5e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:02.793597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:02.805540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-de1f1531-1348-420c-89b7-1e869cd5e018 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:08:02.806713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-de1f1531-1348-420c-89b7-1e869cd5e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:08:02.871450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 621/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:08:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:08:02.894303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723961b-f924-4967-8826-bb8d3ad3dd0a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:02.912592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:02.994891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723961b-f924-4967-8826-bb8d3ad3dd0a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:03.027768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c327e-3189-48c0-aacf-8ac2e5f79782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:03.028616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c327e-3189-48c0-aacf-8ac2e5f79782 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:03.028903 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c327e-3189-48c0-aacf-8ac2e5f79782 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:03.029181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c327e-3189-48c0-aacf-8ac2e5f79782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:03.039447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c327e-3189-48c0-aacf-8ac2e5f79782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ae5c327e-3189-48c0-aacf-8ac2e5f79782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:08:03.047587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:03.048672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:03.049773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 628/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:08:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:08:03.054941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f1531-1348-420c-89b7-1e869cd5e018 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:03.149875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f1531-1348-420c-89b7-1e869cd5e018 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:03.178341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:03.183756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1110df5-d1c1-4917-b806-a54a3db3a6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:03.184439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1110df5-d1c1-4917-b806-a54a3db3a6ea None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:03.184722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1110df5-d1c1-4917-b806-a54a3db3a6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:03.184995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1110df5-d1c1-4917-b806-a54a3db3a6ea None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:03.185725 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1110df5-d1c1-4917-b806-a54a3db3a6ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:03.186046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1110df5-d1c1-4917-b806-a54a3db3a6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:03.187397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1110df5-d1c1-4917-b806-a54a3db3a6ea None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:03.195062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 622/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:08:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:03.200703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c327e-3189-48c0-aacf-8ac2e5f79782 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:03.276131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:03.298776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c327e-3189-48c0-aacf-8ac2e5f79782 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:03.329943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2532e6-d216-4e1c-8c43-9f48e7ca3a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:03.330717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2532e6-d216-4e1c-8c43-9f48e7ca3a1d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:03.330999 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2532e6-d216-4e1c-8c43-9f48e7ca3a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:03.331269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2532e6-d216-4e1c-8c43-9f48e7ca3a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:03.342178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2532e6-d216-4e1c-8c43-9f48e7ca3a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:03.343595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2532e6-d216-4e1c-8c43-9f48e7ca3a1d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ce2532e6-d216-4e1c-8c43-9f48e7ca3a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:08:03.360540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:03.361527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:03.362802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:08:03.362802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:08:03.362802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:03.362802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:03.362802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 629/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:03.367435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1110df5-d1c1-4917-b806-a54a3db3a6ea None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:03.464849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1110df5-d1c1-4917-b806-a54a3db3a6ea None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:03.498079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca16a6-7f05-4663-8bf5-359701f096c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:03.498736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca16a6-7f05-4663-8bf5-359701f096c1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:03.499016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca16a6-7f05-4663-8bf5-359701f096c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:03.499291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca16a6-7f05-4663-8bf5-359701f096c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:03.500006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca16a6-7f05-4663-8bf5-359701f096c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:03.500346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca16a6-7f05-4663-8bf5-359701f096c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:03.501719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca16a6-7f05-4663-8bf5-359701f096c1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:03.513097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 623/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:03.518702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2532e6-d216-4e1c-8c43-9f48e7ca3a1d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:03.615414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2532e6-d216-4e1c-8c43-9f48e7ca3a1d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:03.640927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:03.649501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3a7de-d9a1-4a32-9074-b189ab9b1ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:03.650288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3a7de-d9a1-4a32-9074-b189ab9b1ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:03.650570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3a7de-d9a1-4a32-9074-b189ab9b1ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:03.650843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3a7de-d9a1-4a32-9074-b189ab9b1ad7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:03.658888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3a7de-d9a1-4a32-9074-b189ab9b1ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:03.660334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3a7de-d9a1-4a32-9074-b189ab9b1ad7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-88e3a7de-d9a1-4a32-9074-b189ab9b1ad7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:08:03.674146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:03.677702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:03.678887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 630/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:08:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:03.681060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca16a6-7f05-4663-8bf5-359701f096c1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:03.736603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:03.779639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca16a6-7f05-4663-8bf5-359701f096c1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:03.815449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1312c-c6c6-410e-b428-41df8dff706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:03.816197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1312c-c6c6-410e-b428-41df8dff706d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:03.816515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1312c-c6c6-410e-b428-41df8dff706d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:03.816794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1312c-c6c6-410e-b428-41df8dff706d None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:03.818189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1312c-c6c6-410e-b428-41df8dff706d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:03.818503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1312c-c6c6-410e-b428-41df8dff706d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:03.819943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1312c-c6c6-410e-b428-41df8dff706d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:03.837705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 624/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Thu May 26 03:08:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:03.844033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3a7de-d9a1-4a32-9074-b189ab9b1ad7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:03.943082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3a7de-d9a1-4a32-9074-b189ab9b1ad7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:03.976794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a5712-2890-441a-900b-17b77a0aa2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:03.977439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a5712-2890-441a-900b-17b77a0aa2dd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:03.977723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a5712-2890-441a-900b-17b77a0aa2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:03.977997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a5712-2890-441a-900b-17b77a0aa2dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:04.031993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:04.044438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a5712-2890-441a-900b-17b77a0aa2dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:04.045922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a5712-2890-441a-900b-17b77a0aa2dd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:04.140240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 631/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:08:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:08:04.146116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1312c-c6c6-410e-b428-41df8dff706d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:04.242555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1312c-c6c6-410e-b428-41df8dff706d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:04.255874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:04.277233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a24789-9712-42de-8b6d-b387fdf4ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:04.278018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a24789-9712-42de-8b6d-b387fdf4ad76 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:04.278304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a24789-9712-42de-8b6d-b387fdf4ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:04.278583 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a24789-9712-42de-8b6d-b387fdf4ad76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:04.288978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a24789-9712-42de-8b6d-b387fdf4ad76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:04.290478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a24789-9712-42de-8b6d-b387fdf4ad76 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-21a24789-9712-42de-8b6d-b387fdf4ad76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:08:04.308277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:04.312296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:04.313486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:08:04.313486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:08:04.313486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:04.313486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:04.313486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 625/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:04.315422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a5712-2890-441a-900b-17b77a0aa2dd None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:04.402728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:04.414603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a5712-2890-441a-900b-17b77a0aa2dd None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:04.448398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6e10-8177-40bd-8c0f-083a9251db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:04.449057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6e10-8177-40bd-8c0f-083a9251db1e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:04.449338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6e10-8177-40bd-8c0f-083a9251db1e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:04.449616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6e10-8177-40bd-8c0f-083a9251db1e None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:04.450376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6e10-8177-40bd-8c0f-083a9251db1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:04.450683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6e10-8177-40bd-8c0f-083a9251db1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:04.452044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6e10-8177-40bd-8c0f-083a9251db1e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:04.463302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 632/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:04.469146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a24789-9712-42de-8b6d-b387fdf4ad76 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:04.565705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a24789-9712-42de-8b6d-b387fdf4ad76 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:04.598186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46476510-410f-4d16-a23d-a66d43f7405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:04.599166 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46476510-410f-4d16-a23d-a66d43f7405c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:04.599488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46476510-410f-4d16-a23d-a66d43f7405c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:04.599766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46476510-410f-4d16-a23d-a66d43f7405c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:04.606797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46476510-410f-4d16-a23d-a66d43f7405c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:04.608239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46476510-410f-4d16-a23d-a66d43f7405c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-46476510-410f-4d16-a23d-a66d43f7405c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:08:04.622362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:04.623436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:04.624591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:08:04.624591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:08:04.624591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:08:04.624591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:08:04.624591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:08:04.624591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:08:04.624591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:08:04.624591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:04.624591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 626/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:04.629359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6e10-8177-40bd-8c0f-083a9251db1e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:04.726175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6e10-8177-40bd-8c0f-083a9251db1e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:04.759124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733cc96-6c33-4e46-ab98-e90aed259756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:04.759776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cc96-6c33-4e46-ab98-e90aed259756 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:04.760056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cc96-6c33-4e46-ab98-e90aed259756 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:04.760345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cc96-6c33-4e46-ab98-e90aed259756 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:04.761184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733cc96-6c33-4e46-ab98-e90aed259756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:04.761485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733cc96-6c33-4e46-ab98-e90aed259756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:04.768431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733cc96-6c33-4e46-ab98-e90aed259756 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:04.774427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 633/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:04.781000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46476510-410f-4d16-a23d-a66d43f7405c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:04.806999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:04.880151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46476510-410f-4d16-a23d-a66d43f7405c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:04.913155 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e63654-17f0-489b-8a6d-1d31fe355036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:04.913823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e63654-17f0-489b-8a6d-1d31fe355036 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:04.914108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e63654-17f0-489b-8a6d-1d31fe355036 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:04.914385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e63654-17f0-489b-8a6d-1d31fe355036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:04.915259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e63654-17f0-489b-8a6d-1d31fe355036 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=257d9a088fa04cd5af48d6e4fb8b2f0e) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:04.915585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e63654-17f0-489b-8a6d-1d31fe355036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:04.917652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e63654-17f0-489b-8a6d-1d31fe355036 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:04.923147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 627/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:08:04 2022] GET /identity/v3/role_assignments?user.id=257d9a088fa04cd5af48d6e4fb8b2f0e&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:07.066431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e12ad-6b86-4a38-b496-f714cf4d1001 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:07.066954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e12ad-6b86-4a38-b496-f714cf4d1001 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:07.066954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e12ad-6b86-4a38-b496-f714cf4d1001 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:07.068275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 634/1261] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:08:07.073929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb089e77-0850-4d56-a9c9-ec395497cfdb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:07.074347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb089e77-0850-4d56-a9c9-ec395497cfdb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:07.074455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb089e77-0850-4d56-a9c9-ec395497cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:07.091370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fb089e77-0850-4d56-a9c9-ec395497cfdb None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:08:07.092580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fb089e77-0850-4d56-a9c9-ec395497cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:08:07.157693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 628/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:08:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:08:07.180068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e12ad-6b86-4a38-b496-f714cf4d1001 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:07.191274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:07.281279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e12ad-6b86-4a38-b496-f714cf4d1001 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:07.314254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d14e-d7b0-4336-9044-ed4c5aaa75e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:07.315039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d14e-d7b0-4336-9044-ed4c5aaa75e2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:07.315319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d14e-d7b0-4336-9044-ed4c5aaa75e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:07.315592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d14e-d7b0-4336-9044-ed4c5aaa75e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:07.330801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4d14e-d7b0-4336-9044-ed4c5aaa75e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-11f4d14e-d7b0-4336-9044-ed4c5aaa75e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:08:07.333904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:07.335000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:07.335959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 635/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:08:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:07.341357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb089e77-0850-4d56-a9c9-ec395497cfdb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:07.359680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:07.438138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb089e77-0850-4d56-a9c9-ec395497cfdb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:07.471246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087760c-b5e4-4159-a6df-dfb94a9eca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:07.471909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087760c-b5e4-4159-a6df-dfb94a9eca89 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:07.472194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087760c-b5e4-4159-a6df-dfb94a9eca89 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:07.472505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087760c-b5e4-4159-a6df-dfb94a9eca89 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:07.473247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087760c-b5e4-4159-a6df-dfb94a9eca89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:07.473551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087760c-b5e4-4159-a6df-dfb94a9eca89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:07.474925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087760c-b5e4-4159-a6df-dfb94a9eca89 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:07.483261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 629/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:07.489041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d14e-d7b0-4336-9044-ed4c5aaa75e2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:07.557103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:07.589377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d14e-d7b0-4336-9044-ed4c5aaa75e2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:07.621946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345ed2a-071f-4ffb-8264-fa4a58f5e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:07.622727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345ed2a-071f-4ffb-8264-fa4a58f5e974 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:07.623014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345ed2a-071f-4ffb-8264-fa4a58f5e974 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:07.623294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345ed2a-071f-4ffb-8264-fa4a58f5e974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:07.633508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345ed2a-071f-4ffb-8264-fa4a58f5e974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:07.634974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345ed2a-071f-4ffb-8264-fa4a58f5e974 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-2345ed2a-071f-4ffb-8264-fa4a58f5e974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:08:07.651408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:07.652494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:07.653599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:08:07.653599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:08:07.653599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:07.653599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:07.653599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 636/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:07.658423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087760c-b5e4-4159-a6df-dfb94a9eca89 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:07.739209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:07.757530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087760c-b5e4-4159-a6df-dfb94a9eca89 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:07.789764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb41bc-636d-49a7-ad1f-9f639dfde1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:07.793400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb41bc-636d-49a7-ad1f-9f639dfde1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:07.793673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb41bc-636d-49a7-ad1f-9f639dfde1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:07.794106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb41bc-636d-49a7-ad1f-9f639dfde1a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:07.795237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb41bc-636d-49a7-ad1f-9f639dfde1a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:07.797835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb41bc-636d-49a7-ad1f-9f639dfde1a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:07.797835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb41bc-636d-49a7-ad1f-9f639dfde1a5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:07.808338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 630/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:07.814283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345ed2a-071f-4ffb-8264-fa4a58f5e974 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:07.910587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345ed2a-071f-4ffb-8264-fa4a58f5e974 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:07.932410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:07.945661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a83d-3953-4edc-aa40-49a2235f097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:07.946450 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a83d-3953-4edc-aa40-49a2235f097a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:07.946731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a83d-3953-4edc-aa40-49a2235f097a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:07.947001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a83d-3953-4edc-aa40-49a2235f097a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:07.954312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148a83d-3953-4edc-aa40-49a2235f097a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:07.955734 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148a83d-3953-4edc-aa40-49a2235f097a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a148a83d-3953-4edc-aa40-49a2235f097a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:08:07.970427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:07.971385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:07.972731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 637/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:08:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:07.977392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb41bc-636d-49a7-ad1f-9f639dfde1a5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:08.073788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb41bc-636d-49a7-ad1f-9f639dfde1a5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:08.107310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bea71-4f36-4397-ad12-f6ac7801f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:08.107968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bea71-4f36-4397-ad12-f6ac7801f508 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:08.108248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bea71-4f36-4397-ad12-f6ac7801f508 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:08.108569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bea71-4f36-4397-ad12-f6ac7801f508 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:08.109389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bea71-4f36-4397-ad12-f6ac7801f508 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:08.109694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bea71-4f36-4397-ad12-f6ac7801f508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:08.111118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bea71-4f36-4397-ad12-f6ac7801f508 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:08.119946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:08.127907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 631/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Thu May 26 03:08:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:08.133505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a83d-3953-4edc-aa40-49a2235f097a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:08.240667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a83d-3953-4edc-aa40-49a2235f097a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:08.274470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f772416-2d37-4f98-ba81-fec24080e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:08.275358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772416-2d37-4f98-ba81-fec24080e7cb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:08.275716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772416-2d37-4f98-ba81-fec24080e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:08.276066 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772416-2d37-4f98-ba81-fec24080e7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:08.291525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f772416-2d37-4f98-ba81-fec24080e7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:08.293038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f772416-2d37-4f98-ba81-fec24080e7cb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-7f772416-2d37-4f98-ba81-fec24080e7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:08:08.312447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:08.313568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:08.314670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:08:08.314670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:08:08.314670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:08.314670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:08.319699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bea71-4f36-4397-ad12-f6ac7801f508 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:08.320139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 638/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:08.420769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bea71-4f36-4397-ad12-f6ac7801f508 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:08.456385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325410f8-2e55-4ebe-b93e-0d770d030bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:08.457052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325410f8-2e55-4ebe-b93e-0d770d030bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:08.457335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325410f8-2e55-4ebe-b93e-0d770d030bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:08.457610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325410f8-2e55-4ebe-b93e-0d770d030bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:08.458330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325410f8-2e55-4ebe-b93e-0d770d030bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:08.458639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325410f8-2e55-4ebe-b93e-0d770d030bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:08.460009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325410f8-2e55-4ebe-b93e-0d770d030bc1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:08.472024 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 632/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:08.477810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f772416-2d37-4f98-ba81-fec24080e7cb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:08.509561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:08.576053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f772416-2d37-4f98-ba81-fec24080e7cb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:08.608199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94303ddf-41e1-4637-8337-ba22deb66a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:08.609014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94303ddf-41e1-4637-8337-ba22deb66a40 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:08.609299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94303ddf-41e1-4637-8337-ba22deb66a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:08.609575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94303ddf-41e1-4637-8337-ba22deb66a40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:08.616062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94303ddf-41e1-4637-8337-ba22deb66a40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:08.617565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94303ddf-41e1-4637-8337-ba22deb66a40 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-94303ddf-41e1-4637-8337-ba22deb66a40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:08:08.631333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:08.633489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:08.634570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:08:08.634570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:08:08.634570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:08:08.634570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:08:08.634570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:08:08.634570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:08:08.634570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:08:08.634570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:08.634570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 639/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:08.638881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325410f8-2e55-4ebe-b93e-0d770d030bc1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:08.695892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:08.736020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325410f8-2e55-4ebe-b93e-0d770d030bc1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:08.768492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d8ffc-161f-4d32-8986-10c017ab8bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:08.769089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d8ffc-161f-4d32-8986-10c017ab8bfb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:08.769373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d8ffc-161f-4d32-8986-10c017ab8bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:08.769651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d8ffc-161f-4d32-8986-10c017ab8bfb None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:08.770431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d8ffc-161f-4d32-8986-10c017ab8bfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:08.770743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d8ffc-161f-4d32-8986-10c017ab8bfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:08.772189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d8ffc-161f-4d32-8986-10c017ab8bfb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:08.785960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 633/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:08:08.791891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94303ddf-41e1-4637-8337-ba22deb66a40 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:08.882348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:08.890710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94303ddf-41e1-4637-8337-ba22deb66a40 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:08.924882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcf758-3d57-4588-b5a9-f3c5fab58e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:08.925698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcf758-3d57-4588-b5a9-f3c5fab58e59 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:08.925982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcf758-3d57-4588-b5a9-f3c5fab58e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:08.926256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcf758-3d57-4588-b5a9-f3c5fab58e59 None admin] PATH_INFO: `/v3/projects/d0107b46167b4923b4bcec527390ec96/users/257d9a088fa04cd5af48d6e4fb8b2f0e/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:08.928552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcf758-3d57-4588-b5a9-f3c5fab58e59 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0107b46167b4923b4bcec527390ec96, user_id=257d9a088fa04cd5af48d6e4fb8b2f0e, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:08.930560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcf758-3d57-4588-b5a9-f3c5fab58e59 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:09.034451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 640/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Thu May 26 03:08:08 2022] PUT /identity/v3/projects/d0107b46167b4923b4bcec527390ec96/users/257d9a088fa04cd5af48d6e4fb8b2f0e/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:08:11.187068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05264831-aa40-4ab2-ac48-8ff0c1949bbc None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:11.187571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05264831-aa40-4ab2-ac48-8ff0c1949bbc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:11.187571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05264831-aa40-4ab2-ac48-8ff0c1949bbc None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:11.188959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 634/1274] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:08:11.194316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2541a2-51d4-48cd-81ef-0b9700265fea None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:11.197277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2541a2-51d4-48cd-81ef-0b9700265fea None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:11.197277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2541a2-51d4-48cd-81ef-0b9700265fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:11.212198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4d2541a2-51d4-48cd-81ef-0b9700265fea None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:08:11.213404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4d2541a2-51d4-48cd-81ef-0b9700265fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:08:11.278955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 641/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:08:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:08:11.301701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05264831-aa40-4ab2-ac48-8ff0c1949bbc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:11.401024 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05264831-aa40-4ab2-ac48-8ff0c1949bbc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:11.418127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:11.434236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607b505-dd19-4b38-bc9f-61648dea0f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:11.435023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b505-dd19-4b38-bc9f-61648dea0f71 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:11.435308 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b505-dd19-4b38-bc9f-61648dea0f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:11.435581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b505-dd19-4b38-bc9f-61648dea0f71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:11.445542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607b505-dd19-4b38-bc9f-61648dea0f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9607b505-dd19-4b38-bc9f-61648dea0f71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 03:08:11.453626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:11.456020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:11.456984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 635/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Thu May 26 03:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:11.460810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2541a2-51d4-48cd-81ef-0b9700265fea None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:11.540752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:11.558166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2541a2-51d4-48cd-81ef-0b9700265fea None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:11.593275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a88e-85a3-4ac5-a533-e99c6191b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:11.593978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a88e-85a3-4ac5-a533-e99c6191b663 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:11.594257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a88e-85a3-4ac5-a533-e99c6191b663 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:11.594527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a88e-85a3-4ac5-a533-e99c6191b663 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:11.595250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a88e-85a3-4ac5-a533-e99c6191b663 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:11.595548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a88e-85a3-4ac5-a533-e99c6191b663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:11.596924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a88e-85a3-4ac5-a533-e99c6191b663 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:11.604881 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 642/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu May 26 03:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:11.610525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607b505-dd19-4b38-bc9f-61648dea0f71 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:11.710111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607b505-dd19-4b38-bc9f-61648dea0f71 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:11.747806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee195ab-10c8-48e1-96e5-1b962e1384a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:11.748660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee195ab-10c8-48e1-96e5-1b962e1384a6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:11.748943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee195ab-10c8-48e1-96e5-1b962e1384a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:11.749217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee195ab-10c8-48e1-96e5-1b962e1384a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:11.761757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee195ab-10c8-48e1-96e5-1b962e1384a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:11.763248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee195ab-10c8-48e1-96e5-1b962e1384a6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1ee195ab-10c8-48e1-96e5-1b962e1384a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:08:11.781421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:11.782441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:11.783373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:08:11.783373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:08:11.783373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:11.783373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:11.783373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 636/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 03:08:11.788845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a88e-85a3-4ac5-a533-e99c6191b663 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:11.901432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a88e-85a3-4ac5-a533-e99c6191b663 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:11.938209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9f7c-18e9-4d73-bca6-ce418b3c9fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:11.938885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9f7c-18e9-4d73-bca6-ce418b3c9fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:11.939168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9f7c-18e9-4d73-bca6-ce418b3c9fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:11.939443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9f7c-18e9-4d73-bca6-ce418b3c9fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:11.940168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9f7c-18e9-4d73-bca6-ce418b3c9fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:11.940506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9f7c-18e9-4d73-bca6-ce418b3c9fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:11.941877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9f7c-18e9-4d73-bca6-ce418b3c9fe1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:11.955323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 643/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:11.966186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee195ab-10c8-48e1-96e5-1b962e1384a6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:11.996232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:12.071272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee195ab-10c8-48e1-96e5-1b962e1384a6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:12.107451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b723cd8-09e4-4f54-b745-9aff826f9bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:12.108253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b723cd8-09e4-4f54-b745-9aff826f9bcd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:12.108574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b723cd8-09e4-4f54-b745-9aff826f9bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:12.108849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b723cd8-09e4-4f54-b745-9aff826f9bcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:12.116104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b723cd8-09e4-4f54-b745-9aff826f9bcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:12.117597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b723cd8-09e4-4f54-b745-9aff826f9bcd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5b723cd8-09e4-4f54-b745-9aff826f9bcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 03:08:12.133123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:12.136848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:12.138009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 637/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:08:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:12.140492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9f7c-18e9-4d73-bca6-ce418b3c9fe1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:12.144455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:12.243418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9f7c-18e9-4d73-bca6-ce418b3c9fe1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:12.276813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac571-5231-4de9-b776-794fb3fc2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:12.277479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac571-5231-4de9-b776-794fb3fc2064 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:12.277759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac571-5231-4de9-b776-794fb3fc2064 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:12.278031 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac571-5231-4de9-b776-794fb3fc2064 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:12.278851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac571-5231-4de9-b776-794fb3fc2064 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:12.279159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac571-5231-4de9-b776-794fb3fc2064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:12.280619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac571-5231-4de9-b776-794fb3fc2064 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:12.298432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 644/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Thu May 26 03:08:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:12.304351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b723cd8-09e4-4f54-b745-9aff826f9bcd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:12.391649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:12.400780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b723cd8-09e4-4f54-b745-9aff826f9bcd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:12.434402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef7adb-7afb-4732-b75f-37c48f82b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:12.435061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef7adb-7afb-4732-b75f-37c48f82b3ad None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:12.435327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef7adb-7afb-4732-b75f-37c48f82b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:12.435608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef7adb-7afb-4732-b75f-37c48f82b3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:12.500878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef7adb-7afb-4732-b75f-37c48f82b3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:12.502336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef7adb-7afb-4732-b75f-37c48f82b3ad None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:12.586864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:12.597351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 638/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Thu May 26 03:08:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 03:08:12.603285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac571-5231-4de9-b776-794fb3fc2064 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:12.663500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:12.701849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac571-5231-4de9-b776-794fb3fc2064 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:12.734584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea417c-e75d-4e29-bb55-841f33b2ddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:12.735682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea417c-e75d-4e29-bb55-841f33b2ddf3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:12.735993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea417c-e75d-4e29-bb55-841f33b2ddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:12.736296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea417c-e75d-4e29-bb55-841f33b2ddf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:12.746536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea417c-e75d-4e29-bb55-841f33b2ddf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:12.748704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea417c-e75d-4e29-bb55-841f33b2ddf3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-32ea417c-e75d-4e29-bb55-841f33b2ddf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 03:08:12.771826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:12.772927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:12.774060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 03:08:12.774060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 03:08:12.774060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 03:08:12.774060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:12.774060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 645/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:12.774402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef7adb-7afb-4732-b75f-37c48f82b3ad None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:12.868803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef7adb-7afb-4732-b75f-37c48f82b3ad None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:12.901975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c794ba2-08c5-410d-ba34-8f86e483e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:12.902660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c794ba2-08c5-410d-ba34-8f86e483e233 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:12.902938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c794ba2-08c5-410d-ba34-8f86e483e233 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:12.903209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c794ba2-08c5-410d-ba34-8f86e483e233 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:12.903913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c794ba2-08c5-410d-ba34-8f86e483e233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:12.904213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c794ba2-08c5-410d-ba34-8f86e483e233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:12.905604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c794ba2-08c5-410d-ba34-8f86e483e233 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:12.916365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 639/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Thu May 26 03:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:12.922157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea417c-e75d-4e29-bb55-841f33b2ddf3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:13.019716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea417c-e75d-4e29-bb55-841f33b2ddf3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:13.032775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:13.051695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db97f-d191-4908-8229-bf32e9762e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:13.052510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db97f-d191-4908-8229-bf32e9762e20 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:13.052800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db97f-d191-4908-8229-bf32e9762e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:13.053080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7db97f-d191-4908-8229-bf32e9762e20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:13.060297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7db97f-d191-4908-8229-bf32e9762e20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:13.061724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7db97f-d191-4908-8229-bf32e9762e20 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ac7db97f-d191-4908-8229-bf32e9762e20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 03:08:13.076635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:13.080119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:13.081270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 03:08:13.081270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 03:08:13.081270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 03:08:13.081270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 03:08:13.081270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 03:08:13.081270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 03:08:13.081270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 03:08:13.081270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application May 26 03:08:13.081270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 646/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Thu May 26 03:08:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:13.084063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c794ba2-08c5-410d-ba34-8f86e483e233 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:13.133337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:13.180148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c794ba2-08c5-410d-ba34-8f86e483e233 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:13.213076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41cb94-e707-4526-818b-095f6e242dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:13.213744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41cb94-e707-4526-818b-095f6e242dce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:13.214027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41cb94-e707-4526-818b-095f6e242dce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:13.214301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41cb94-e707-4526-818b-095f6e242dce None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:13.215074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41cb94-e707-4526-818b-095f6e242dce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:13.215412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41cb94-e707-4526-818b-095f6e242dce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:13.216881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41cb94-e707-4526-818b-095f6e242dce None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:13.229521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 640/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Thu May 26 03:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:13.235846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db97f-d191-4908-8229-bf32e9762e20 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:13.331028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7db97f-d191-4908-8229-bf32e9762e20 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:13.363490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037cb9a-54c5-4034-a0c9-7e2ea7de5ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:13.364123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037cb9a-54c5-4034-a0c9-7e2ea7de5ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:13.364432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037cb9a-54c5-4034-a0c9-7e2ea7de5ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:13.364726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037cb9a-54c5-4034-a0c9-7e2ea7de5ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:13.365517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037cb9a-54c5-4034-a0c9-7e2ea7de5ce4 None admin] RBAC: Adding query filter params (role.id=ca945c946b2e4b67a9cba29a1f174f60, scope.project.id=d0107b46167b4923b4bcec527390ec96, user.id=257d9a088fa04cd5af48d6e4fb8b2f0e) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:13.365825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037cb9a-54c5-4034-a0c9-7e2ea7de5ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:13.367223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037cb9a-54c5-4034-a0c9-7e2ea7de5ce4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:13.373498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 647/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Thu May 26 03:08:13 2022] GET /identity/v3/role_assignments?user.id=257d9a088fa04cd5af48d6e4fb8b2f0e&scope.project.id=d0107b46167b4923b4bcec527390ec96&role.id=ca945c946b2e4b67a9cba29a1f174f60 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:15.567890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcf585-82fa-45fb-9587-c92891ed2681 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:15.568479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcf585-82fa-45fb-9587-c92891ed2681 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:15.568568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcf585-82fa-45fb-9587-c92891ed2681 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:15.569890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 641/1288] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:08:15.575213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194e6a-634e-460b-be8e-c118d0ae223a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:15.575648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194e6a-634e-460b-be8e-c118d0ae223a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:15.575781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194e6a-634e-460b-be8e-c118d0ae223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:15.593136 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dc194e6a-634e-460b-be8e-c118d0ae223a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:08:15.594314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dc194e6a-634e-460b-be8e-c118d0ae223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:08:15.624502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:15.661923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 648/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:08:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:08:15.683712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcf585-82fa-45fb-9587-c92891ed2681 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:15.783532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcf585-82fa-45fb-9587-c92891ed2681 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:15.794486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:15.819928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8b988-c111-4dec-bb4b-9c74bb67648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:15.820699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8b988-c111-4dec-bb4b-9c74bb67648a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:15.820987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8b988-c111-4dec-bb4b-9c74bb67648a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:15.821266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8b988-c111-4dec-bb4b-9c74bb67648a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:15.821963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8b988-c111-4dec-bb4b-9c74bb67648a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:15.823972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8b988-c111-4dec-bb4b-9c74bb67648a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a6b8b988-c111-4dec-bb4b-9c74bb67648a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:15.835991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:15.837526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:15.838568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 642/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:08:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:15.844337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194e6a-634e-460b-be8e-c118d0ae223a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:15.940415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194e6a-634e-460b-be8e-c118d0ae223a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:15.973263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedc685-f616-48d7-a168-b9ba82bbe115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:15.973917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedc685-f616-48d7-a168-b9ba82bbe115 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:15.974199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedc685-f616-48d7-a168-b9ba82bbe115 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:15.974472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedc685-f616-48d7-a168-b9ba82bbe115 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:15.975161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedc685-f616-48d7-a168-b9ba82bbe115 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:15.975464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedc685-f616-48d7-a168-b9ba82bbe115 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:15.976936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedc685-f616-48d7-a168-b9ba82bbe115 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:15.982135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 649/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Thu May 26 03:08:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:15.987822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8b988-c111-4dec-bb4b-9c74bb67648a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:16.085401 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8b988-c111-4dec-bb4b-9c74bb67648a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:16.119126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad6425-4659-4d78-8e61-f99d1d404c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:16.119792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad6425-4659-4d78-8e61-f99d1d404c35 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:16.120093 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad6425-4659-4d78-8e61-f99d1d404c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:16.120400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad6425-4659-4d78-8e61-f99d1d404c35 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:16.121101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad6425-4659-4d78-8e61-f99d1d404c35 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:16.121411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad6425-4659-4d78-8e61-f99d1d404c35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:16.122780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad6425-4659-4d78-8e61-f99d1d404c35 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:16.127221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 643/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Thu May 26 03:08:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:18.289018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72020156-6562-421c-9faa-c65beff3e40c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:18.289541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72020156-6562-421c-9faa-c65beff3e40c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:18.289660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72020156-6562-421c-9faa-c65beff3e40c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:18.290978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 650/1293] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:08:18.296693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d134-7f28-44bf-a468-6ce7f6da5395 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:18.297116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d134-7f28-44bf-a468-6ce7f6da5395 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:18.297253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d134-7f28-44bf-a468-6ce7f6da5395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:18.314278 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2408d134-7f28-44bf-a468-6ce7f6da5395 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:08:18.315475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2408d134-7f28-44bf-a468-6ce7f6da5395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:08:18.344833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:18.379713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 644/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:08:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:08:18.402747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72020156-6562-421c-9faa-c65beff3e40c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:18.434563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:18.501779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72020156-6562-421c-9faa-c65beff3e40c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:18.534513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa6808-f77e-4197-ae94-547d0c7e075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:18.535163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa6808-f77e-4197-ae94-547d0c7e075a None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:18.535451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa6808-f77e-4197-ae94-547d0c7e075a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:18.535720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa6808-f77e-4197-ae94-547d0c7e075a None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:18.536447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa6808-f77e-4197-ae94-547d0c7e075a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:18.537792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa6808-f77e-4197-ae94-547d0c7e075a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:18.611839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 651/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Thu May 26 03:08:18 2022] POST /identity/v3/services => generated 246 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:08:20.773990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d8e4-1ec5-4bd6-9c86-2f8446284257 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:20.774631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d8e4-1ec5-4bd6-9c86-2f8446284257 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:20.774631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d8e4-1ec5-4bd6-9c86-2f8446284257 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:20.775888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 645/1296] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:08:20.781177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6b372-9c73-4dc8-bc83-6cebf0eb541f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:20.781605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6b372-9c73-4dc8-bc83-6cebf0eb541f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:20.781714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6b372-9c73-4dc8-bc83-6cebf0eb541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:20.798184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-80b6b372-9c73-4dc8-bc83-6cebf0eb541f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:08:20.800024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-80b6b372-9c73-4dc8-bc83-6cebf0eb541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:08:20.871365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 652/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:08:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 03:08:20.893953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d8e4-1ec5-4bd6-9c86-2f8446284257 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:20.991231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d8e4-1ec5-4bd6-9c86-2f8446284257 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:21.025178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bed66b-c6b1-41e9-895d-e23138da93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:21.025896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bed66b-c6b1-41e9-895d-e23138da93a5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:21.026174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bed66b-c6b1-41e9-895d-e23138da93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:21.026445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bed66b-c6b1-41e9-895d-e23138da93a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:21.027079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bed66b-c6b1-41e9-895d-e23138da93a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:21.028515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bed66b-c6b1-41e9-895d-e23138da93a5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-73bed66b-c6b1-41e9-895d-e23138da93a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:21.040012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:21.043485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:21.044682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 646/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:08:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:21.047882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6b372-9c73-4dc8-bc83-6cebf0eb541f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:21.066184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:21.145028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6b372-9c73-4dc8-bc83-6cebf0eb541f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:21.177996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daecde-42d4-4c98-9920-9ea58fd02743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:21.178646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daecde-42d4-4c98-9920-9ea58fd02743 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:21.178928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daecde-42d4-4c98-9920-9ea58fd02743 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:21.179204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daecde-42d4-4c98-9920-9ea58fd02743 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:21.179899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daecde-42d4-4c98-9920-9ea58fd02743 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:21.180207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daecde-42d4-4c98-9920-9ea58fd02743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:21.181583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daecde-42d4-4c98-9920-9ea58fd02743 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:21.187141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 653/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Thu May 26 03:08:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:21.193207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bed66b-c6b1-41e9-895d-e23138da93a5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:21.224058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:21.291441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bed66b-c6b1-41e9-895d-e23138da93a5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:21.324427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bf79c-ac03-4f0e-a95f-1c7fae9e67a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:21.325125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf79c-ac03-4f0e-a95f-1c7fae9e67a2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:21.325410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf79c-ac03-4f0e-a95f-1c7fae9e67a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:21.325688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf79c-ac03-4f0e-a95f-1c7fae9e67a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:21.326472 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bf79c-ac03-4f0e-a95f-1c7fae9e67a2 None admin] RBAC: Adding query filter params (interface=public, service_id=fdbb940c09b74582b378397fc751abbb, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:21.326783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bf79c-ac03-4f0e-a95f-1c7fae9e67a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:21.328155 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bf79c-ac03-4f0e-a95f-1c7fae9e67a2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:21.333109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 647/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Thu May 26 03:08:21 2022] GET /identity/v3/endpoints?service_id=fdbb940c09b74582b378397fc751abbb&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:21.339629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daecde-42d4-4c98-9920-9ea58fd02743 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:21.421031 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:21.438209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daecde-42d4-4c98-9920-9ea58fd02743 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:21.470542 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87cd45-099f-41af-ba89-e2d333aff9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:21.471191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87cd45-099f-41af-ba89-e2d333aff9ec None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:21.471472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87cd45-099f-41af-ba89-e2d333aff9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:21.471742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87cd45-099f-41af-ba89-e2d333aff9ec None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:21.472427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87cd45-099f-41af-ba89-e2d333aff9ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:21.473777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87cd45-099f-41af-ba89-e2d333aff9ec None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:21.480945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 654/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Thu May 26 03:08:21 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:08:23.638609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbb705-7e32-4985-a795-511f046fefda None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:23.639185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbb705-7e32-4985-a795-511f046fefda None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:23.639185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbb705-7e32-4985-a795-511f046fefda None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:23.640620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 648/1302] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:08:23.645829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582682e0-08cd-4915-946a-1b255712d1cd None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:23.646272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582682e0-08cd-4915-946a-1b255712d1cd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:23.646375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582682e0-08cd-4915-946a-1b255712d1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:23.662902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-582682e0-08cd-4915-946a-1b255712d1cd None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:08:23.664065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-582682e0-08cd-4915-946a-1b255712d1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:08:23.728904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 655/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:08:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 03:08:23.752016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbb705-7e32-4985-a795-511f046fefda None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:23.849836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:23.857082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbb705-7e32-4985-a795-511f046fefda None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:23.890323 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd68ad-4f32-4438-82b4-5f051994c834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:23.891034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd68ad-4f32-4438-82b4-5f051994c834 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:23.891317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd68ad-4f32-4438-82b4-5f051994c834 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:23.891594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd68ad-4f32-4438-82b4-5f051994c834 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:23.892238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd68ad-4f32-4438-82b4-5f051994c834 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:23.893637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd68ad-4f32-4438-82b4-5f051994c834 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a6dd68ad-4f32-4438-82b4-5f051994c834 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 03:08:23.905712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 03:08:23.906884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application May 26 03:08:23.908000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 649/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Thu May 26 03:08:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 03:08:23.913015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582682e0-08cd-4915-946a-1b255712d1cd None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:23.986869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:24.008549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582682e0-08cd-4915-946a-1b255712d1cd None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:24.040716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbb4fd-58a8-498b-9a16-a8068fae8cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:24.041367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbb4fd-58a8-498b-9a16-a8068fae8cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:24.042144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbb4fd-58a8-498b-9a16-a8068fae8cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:24.042436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbb4fd-58a8-498b-9a16-a8068fae8cc1 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:24.043119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbb4fd-58a8-498b-9a16-a8068fae8cc1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:08:24.043422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbb4fd-58a8-498b-9a16-a8068fae8cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:24.044804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbb4fd-58a8-498b-9a16-a8068fae8cc1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:24.049718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 656/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Thu May 26 03:08:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:08:24.055471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd68ad-4f32-4438-82b4-5f051994c834 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:08:24.154686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd68ad-4f32-4438-82b4-5f051994c834 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:08:24.187474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ca496-fba1-4df8-9d08-1ba8dcb69b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:08:24.188114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ca496-fba1-4df8-9d08-1ba8dcb69b48 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:08:24.188421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ca496-fba1-4df8-9d08-1ba8dcb69b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:08:24.188698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ca496-fba1-4df8-9d08-1ba8dcb69b48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:08:24.189426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ca496-fba1-4df8-9d08-1ba8dcb69b48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:08:24.190780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ca496-fba1-4df8-9d08-1ba8dcb69b48 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:08:24.297858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 650/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu May 26 03:08:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:08:34.092504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=30 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:08:34.293290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:13:55.780228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419b720-ea61-4dbf-9770-61c48ed73357 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:13:55.781185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419b720-ea61-4dbf-9770-61c48ed73357 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:13:55.781642 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419b720-ea61-4dbf-9770-61c48ed73357 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:13:55.789260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41848c5-490d-421a-840f-8d74b7d3b097 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:13:55.790109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41848c5-490d-421a-840f-8d74b7d3b097 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:13:55.790547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41848c5-490d-421a-840f-8d74b7d3b097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:13:55.794369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 657/1307] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:13:55 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:13:55.868580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f41848c5-490d-421a-840f-8d74b7d3b097 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:13:55.870022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f41848c5-490d-421a-840f-8d74b7d3b097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:13:55.996506 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 651/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:13:56.040159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b051b-c078-4c64-a49f-42e83c3d7280 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:13:56.040418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b051b-c078-4c64-a49f-42e83c3d7280 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:13:56.040702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b051b-c078-4c64-a49f-42e83c3d7280 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:13:56.042081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 658/1309] 10.222.0.15 () {54 vars in 964 bytes} [Thu May 26 03:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:13:56.048637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d51b9-3e30-4a81-a7bf-530cd423632d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:13:56.048637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d51b9-3e30-4a81-a7bf-530cd423632d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:13:56.048788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d51b9-3e30-4a81-a7bf-530cd423632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:13:56.131805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a82d51b9-3e30-4a81-a7bf-530cd423632d None None] MFA Rules not processed for user `e22fe8105f01400ab6ac3dc14c7aa7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:13:56.133658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a82d51b9-3e30-4a81-a7bf-530cd423632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:13:56.158947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:13:56.232676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b051b-c078-4c64-a49f-42e83c3d7280 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:13:56.234424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-377b051b-c078-4c64-a49f-42e83c3d7280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:13:56.238362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 652/1310] 10.222.0.15 () {58 vars in 1061 bytes} [Thu May 26 03:13:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:13:56.384632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b051b-c078-4c64-a49f-42e83c3d7280 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:13:56.477896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f09db-bc5d-482b-9b78-dca78e99d8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:13:56.478570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f09db-bc5d-482b-9b78-dca78e99d8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:13:56.478854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f09db-bc5d-482b-9b78-dca78e99d8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:13:56.479138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f09db-bc5d-482b-9b78-dca78e99d8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:13:56.480931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e17f09db-bc5d-482b-9b78-dca78e99d8f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:13:56.543860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:13:56.607903 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f09db-bc5d-482b-9b78-dca78e99d8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:13:56.609647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f09db-bc5d-482b-9b78-dca78e99d8f6 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:13:56.648749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 659/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:13:59.201341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad29fd-b5ad-4470-b930-bcbb86bd2340 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:13:59.201944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad29fd-b5ad-4470-b930-bcbb86bd2340 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:13:59.201944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad29fd-b5ad-4470-b930-bcbb86bd2340 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:13:59.204388 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 653/1312] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:13:59.209297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e3df-986d-47f2-bb3e-71fb4aea2fae None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:13:59.209764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e3df-986d-47f2-bb3e-71fb4aea2fae None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:13:59.209868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e3df-986d-47f2-bb3e-71fb4aea2fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:13:59.295219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5b00e3df-986d-47f2-bb3e-71fb4aea2fae None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:13:59.296477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5b00e3df-986d-47f2-bb3e-71fb4aea2fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:13:59.399830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 660/1313] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:13:59.436942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad29fd-b5ad-4470-b930-bcbb86bd2340 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:13:59.438482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-57ad29fd-b5ad-4470-b930-bcbb86bd2340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:13:59.546473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad29fd-b5ad-4470-b930-bcbb86bd2340 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:13:59.619354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:13:59.625059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb92045-67dc-4fa4-be57-60367826282d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:13:59.625898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92045-67dc-4fa4-be57-60367826282d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:13:59.626190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92045-67dc-4fa4-be57-60367826282d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:13:59.626471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92045-67dc-4fa4-be57-60367826282d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:13:59.628509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7bb92045-67dc-4fa4-be57-60367826282d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:13:59.751892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb92045-67dc-4fa4-be57-60367826282d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:13:59.753384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb92045-67dc-4fa4-be57-60367826282d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:13:59.772391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 654/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:02.429557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594712d-7ef8-479d-bd6b-5e97f6962b1c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:02.430120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594712d-7ef8-479d-bd6b-5e97f6962b1c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:02.430120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594712d-7ef8-479d-bd6b-5e97f6962b1c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:02.431502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 661/1315] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:02.436586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5946cba-2198-440d-a34a-557118351d60 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:02.437034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5946cba-2198-440d-a34a-557118351d60 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:02.437133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5946cba-2198-440d-a34a-557118351d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:02.499950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e5946cba-2198-440d-a34a-557118351d60 None None] MFA Rules not processed for user `3a2b7d51d6c046db8fb911ffb0bedeeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:02.501171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e5946cba-2198-440d-a34a-557118351d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:02.552257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:02.597589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 655/1316] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:02.637195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594712d-7ef8-479d-bd6b-5e97f6962b1c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:02.638728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d594712d-7ef8-479d-bd6b-5e97f6962b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:02.648983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:02.741039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594712d-7ef8-479d-bd6b-5e97f6962b1c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:02.812365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df087f-13aa-4aa8-aca9-af5d464a6fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:02.813014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df087f-13aa-4aa8-aca9-af5d464a6fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:02.813293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df087f-13aa-4aa8-aca9-af5d464a6fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:02.813565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df087f-13aa-4aa8-aca9-af5d464a6fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:02.815185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-86df087f-13aa-4aa8-aca9-af5d464a6fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:02.875292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:02.921027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df087f-13aa-4aa8-aca9-af5d464a6fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:02.922449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df087f-13aa-4aa8-aca9-af5d464a6fbc service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:02.940602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 662/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:05.956793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3123d-4110-4341-a044-688a7909e313 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:05.957346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3123d-4110-4341-a044-688a7909e313 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:05.957346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3123d-4110-4341-a044-688a7909e313 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:05.958734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 656/1318] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:05.964038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb9cef-62aa-4be0-b8c2-56ce77f55d6d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:05.964508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb9cef-62aa-4be0-b8c2-56ce77f55d6d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:05.964631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb9cef-62aa-4be0-b8c2-56ce77f55d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:06.029156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7bcb9cef-62aa-4be0-b8c2-56ce77f55d6d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:06.030367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7bcb9cef-62aa-4be0-b8c2-56ce77f55d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:06.128016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 663/1319] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:06.166225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3123d-4110-4341-a044-688a7909e313 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:06.167807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-81f3123d-4110-4341-a044-688a7909e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:06.270106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3123d-4110-4341-a044-688a7909e313 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:06.341920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a4bf-fe08-4f66-bf88-62e45cd354ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:06.342559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a4bf-fe08-4f66-bf88-62e45cd354ca service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:06.342847 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a4bf-fe08-4f66-bf88-62e45cd354ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:06.343123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a4bf-fe08-4f66-bf88-62e45cd354ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:06.344783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4495a4bf-fe08-4f66-bf88-62e45cd354ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:06.352670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:06.450938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495a4bf-fe08-4f66-bf88-62e45cd354ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:06.452325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495a4bf-fe08-4f66-bf88-62e45cd354ca service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:06.470587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 657/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:09.684204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9351d7-9a3e-43a2-9860-b461aa818247 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:09.684754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9351d7-9a3e-43a2-9860-b461aa818247 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:09.684834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9351d7-9a3e-43a2-9860-b461aa818247 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:09.686349 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 664/1321] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:09.691378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a90fc-4b10-4436-b0a6-001b82f3dca5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:09.691814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a90fc-4b10-4436-b0a6-001b82f3dca5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:09.691958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a90fc-4b10-4436-b0a6-001b82f3dca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:09.762086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-530a90fc-4b10-4436-b0a6-001b82f3dca5 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:09.763292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-530a90fc-4b10-4436-b0a6-001b82f3dca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:09.838562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:09.882548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 658/1322] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:09.917704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9351d7-9a3e-43a2-9860-b461aa818247 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:09.919213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0d9351d7-9a3e-43a2-9860-b461aa818247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:09.938381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:10.027088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9351d7-9a3e-43a2-9860-b461aa818247 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:10.100892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0250f-c279-48bf-b9a7-6edfc3e148d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:10.101572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0250f-c279-48bf-b9a7-6edfc3e148d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:10.101853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0250f-c279-48bf-b9a7-6edfc3e148d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:10.102126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0250f-c279-48bf-b9a7-6edfc3e148d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:10.103745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-afb0250f-c279-48bf-b9a7-6edfc3e148d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:10.173808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:10.212044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0250f-c279-48bf-b9a7-6edfc3e148d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:10.213509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0250f-c279-48bf-b9a7-6edfc3e148d2 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:10.231324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 665/1323] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:12.492421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05871a8-8144-4ff5-8380-cd7fe085df58 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:12.492965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05871a8-8144-4ff5-8380-cd7fe085df58 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:12.492965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05871a8-8144-4ff5-8380-cd7fe085df58 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:12.494555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 659/1324] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:12.499728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b78448-7b82-424e-b89f-4765d5f30e25 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:12.500207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b78448-7b82-424e-b89f-4765d5f30e25 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:12.500303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b78448-7b82-424e-b89f-4765d5f30e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:12.565689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-44b78448-7b82-424e-b89f-4765d5f30e25 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:12.566882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-44b78448-7b82-424e-b89f-4765d5f30e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:12.666636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 666/1325] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:12.702762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05871a8-8144-4ff5-8380-cd7fe085df58 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:12.704570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c05871a8-8144-4ff5-8380-cd7fe085df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:12.809802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05871a8-8144-4ff5-8380-cd7fe085df58 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:12.882714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf466e2-1383-4ce6-97cf-ba1bdecd5b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:12.883359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf466e2-1383-4ce6-97cf-ba1bdecd5b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:12.883648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf466e2-1383-4ce6-97cf-ba1bdecd5b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:12.883925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf466e2-1383-4ce6-97cf-ba1bdecd5b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:12.885580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9cf466e2-1383-4ce6-97cf-ba1bdecd5b01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:12.902514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:12.992485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf466e2-1383-4ce6-97cf-ba1bdecd5b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:12.993935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf466e2-1383-4ce6-97cf-ba1bdecd5b01 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:13.012015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 660/1326] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:15.253209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2288-1794-42ea-a7c1-b4fb233ba83c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:15.253720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2288-1794-42ea-a7c1-b4fb233ba83c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:15.253812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2288-1794-42ea-a7c1-b4fb233ba83c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:15.255165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 667/1327] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:15.260622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747273ea-3d51-4b34-adda-1ae59a529ad2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:15.261034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747273ea-3d51-4b34-adda-1ae59a529ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:15.261186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747273ea-3d51-4b34-adda-1ae59a529ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:15.324516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-747273ea-3d51-4b34-adda-1ae59a529ad2 None None] MFA Rules not processed for user `3a2b7d51d6c046db8fb911ffb0bedeeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:15.325718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-747273ea-3d51-4b34-adda-1ae59a529ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:15.389756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:15.421678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 661/1328] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:15.457830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2288-1794-42ea-a7c1-b4fb233ba83c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:15.459379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fc3c2288-1794-42ea-a7c1-b4fb233ba83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:15.490656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:15.566142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2288-1794-42ea-a7c1-b4fb233ba83c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:15.639192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48378eeb-8e62-4779-ab4d-ef461fae2324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:15.639845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378eeb-8e62-4779-ab4d-ef461fae2324 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:15.640126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378eeb-8e62-4779-ab4d-ef461fae2324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:15.640434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378eeb-8e62-4779-ab4d-ef461fae2324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:15.642058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-48378eeb-8e62-4779-ab4d-ef461fae2324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:15.720473 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:15.751314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48378eeb-8e62-4779-ab4d-ef461fae2324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:15.752796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48378eeb-8e62-4779-ab4d-ef461fae2324 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:15.771250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 668/1329] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:18.566687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5d79b-8711-4334-b847-2b116bc1fbdb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:18.567233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5d79b-8711-4334-b847-2b116bc1fbdb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:18.567233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5d79b-8711-4334-b847-2b116bc1fbdb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:18.568669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 662/1330] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:18.573978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f6455-8e88-4457-954c-d66d3f96667a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:18.574392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f6455-8e88-4457-954c-d66d3f96667a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:18.574540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f6455-8e88-4457-954c-d66d3f96667a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:18.640818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d47f6455-8e88-4457-954c-d66d3f96667a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:18.642010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d47f6455-8e88-4457-954c-d66d3f96667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:18.745189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 669/1331] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:18.776734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5d79b-8711-4334-b847-2b116bc1fbdb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:18.778263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-94d5d79b-8711-4334-b847-2b116bc1fbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:18.884876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5d79b-8711-4334-b847-2b116bc1fbdb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:18.961455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552112c-05e2-4ac9-a3c4-71d63e54776d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:18.962106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552112c-05e2-4ac9-a3c4-71d63e54776d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:18.962386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552112c-05e2-4ac9-a3c4-71d63e54776d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:18.962656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552112c-05e2-4ac9-a3c4-71d63e54776d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:18.964435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6552112c-05e2-4ac9-a3c4-71d63e54776d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:18.992886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:19.075285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552112c-05e2-4ac9-a3c4-71d63e54776d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:19.076692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552112c-05e2-4ac9-a3c4-71d63e54776d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:19.094611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 663/1332] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:21.350778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23805-fe54-4144-b682-32fa8c6fda80 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:21.351344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23805-fe54-4144-b682-32fa8c6fda80 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:21.351344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23805-fe54-4144-b682-32fa8c6fda80 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:21.352743 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 670/1333] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:21.357996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2adf7-33ce-4d74-89f7-efb907262b83 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:21.358404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2adf7-33ce-4d74-89f7-efb907262b83 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:21.358557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2adf7-33ce-4d74-89f7-efb907262b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:21.421039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0ba2adf7-33ce-4d74-89f7-efb907262b83 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:21.422228 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0ba2adf7-33ce-4d74-89f7-efb907262b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:21.494590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:21.517534 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 664/1334] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:21.557377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add23805-fe54-4144-b682-32fa8c6fda80 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:21.558904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-add23805-fe54-4144-b682-32fa8c6fda80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:21.600590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:21.664428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add23805-fe54-4144-b682-32fa8c6fda80 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:21.736972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817ce9a-5e29-4d9a-80d1-3d76931f9566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:21.737611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817ce9a-5e29-4d9a-80d1-3d76931f9566 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:21.737890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817ce9a-5e29-4d9a-80d1-3d76931f9566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:21.738164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817ce9a-5e29-4d9a-80d1-3d76931f9566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:21.739767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8817ce9a-5e29-4d9a-80d1-3d76931f9566 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:21.820941 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:21.846102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817ce9a-5e29-4d9a-80d1-3d76931f9566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:21.847521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817ce9a-5e29-4d9a-80d1-3d76931f9566 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:21.866472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 671/1335] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:24.582736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e24d89-bcf3-43d1-ba19-fc48183f9fb7 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:24.583277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e24d89-bcf3-43d1-ba19-fc48183f9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:24.583277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e24d89-bcf3-43d1-ba19-fc48183f9fb7 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:24.584835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 665/1336] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:24.590275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4815-f6b4-405b-a41b-faf492facb58 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:24.590702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4815-f6b4-405b-a41b-faf492facb58 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:24.590838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4815-f6b4-405b-a41b-faf492facb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:24.654062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-83ea4815-f6b4-405b-a41b-faf492facb58 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:24.655262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-83ea4815-f6b4-405b-a41b-faf492facb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:24.749843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 672/1337] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:24.785247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e24d89-bcf3-43d1-ba19-fc48183f9fb7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:24.786767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f0e24d89-bcf3-43d1-ba19-fc48183f9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:24.888420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e24d89-bcf3-43d1-ba19-fc48183f9fb7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:24.959047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13212638-11ac-4a52-b3be-419d97fd70ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:24.960222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13212638-11ac-4a52-b3be-419d97fd70ec service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:24.960525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13212638-11ac-4a52-b3be-419d97fd70ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:24.960799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13212638-11ac-4a52-b3be-419d97fd70ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:24.962462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13212638-11ac-4a52-b3be-419d97fd70ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:24.997304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:25.068206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13212638-11ac-4a52-b3be-419d97fd70ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:25.069677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13212638-11ac-4a52-b3be-419d97fd70ec service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:25.088264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 666/1338] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:29.395936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978416-88f3-4cdb-a92a-e2e20778a644 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:29.396548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978416-88f3-4cdb-a92a-e2e20778a644 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:29.396548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978416-88f3-4cdb-a92a-e2e20778a644 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:29.397912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 673/1339] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:29.403117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a47cb9-8c87-48b3-836a-0d9e7e44dbe9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:29.403563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a47cb9-8c87-48b3-836a-0d9e7e44dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:29.403719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a47cb9-8c87-48b3-836a-0d9e7e44dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:29.481950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-22a47cb9-8c87-48b3-836a-0d9e7e44dbe9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:29.483210 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-22a47cb9-8c87-48b3-836a-0d9e7e44dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:29.574979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:29.588733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 667/1340] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:29.639377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1d5fc-4465-48da-b05c-20a4bc6531da None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:29.639752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1d5fc-4465-48da-b05c-20a4bc6531da None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:29.640099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1d5fc-4465-48da-b05c-20a4bc6531da None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:29.641581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 674/1341] 10.222.0.15 () {54 vars in 964 bytes} [Thu May 26 03:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:29.648022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8897ab9-dfcc-48d8-9ad8-1a02d33000f7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:29.648478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8897ab9-dfcc-48d8-9ad8-1a02d33000f7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:29.648777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8897ab9-dfcc-48d8-9ad8-1a02d33000f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:29.715239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a8897ab9-dfcc-48d8-9ad8-1a02d33000f7 None None] MFA Rules not processed for user `e22fe8105f01400ab6ac3dc14c7aa7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:29.716456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a8897ab9-dfcc-48d8-9ad8-1a02d33000f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:29.792714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 668/1342] 10.222.0.15 () {58 vars in 1061 bytes} [Thu May 26 03:14:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:29.802216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1d5fc-4465-48da-b05c-20a4bc6531da None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:29.813771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1d5fc-4465-48da-b05c-20a4bc6531da None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:29.817299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a2ca9-282f-4458-a74f-ebe2094dc3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:29.817996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a2ca9-282f-4458-a74f-ebe2094dc3ac service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:29.818366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a2ca9-282f-4458-a74f-ebe2094dc3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:29.818708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a2ca9-282f-4458-a74f-ebe2094dc3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:29.827760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a2ca9-282f-4458-a74f-ebe2094dc3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:29.829466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a2ca9-282f-4458-a74f-ebe2094dc3ac service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:29.839632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 675/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:33.546503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5504cc-47ea-45f5-9fe2-1b618a7a04c1 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:33.546979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5504cc-47ea-45f5-9fe2-1b618a7a04c1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:33.547086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5504cc-47ea-45f5-9fe2-1b618a7a04c1 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:33.548458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 669/1344] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:33.553689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491338-06be-4c31-aa9a-9c45db3d852f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:33.554094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491338-06be-4c31-aa9a-9c45db3d852f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:33.554250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491338-06be-4c31-aa9a-9c45db3d852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:33.581070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c1491338-06be-4c31-aa9a-9c45db3d852f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:33.582248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c1491338-06be-4c31-aa9a-9c45db3d852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:33.600246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:33.658614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 676/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:33.694988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5504cc-47ea-45f5-9fe2-1b618a7a04c1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:33.705748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5504cc-47ea-45f5-9fe2-1b618a7a04c1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:33.709895 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4df6e-8530-4027-ab10-510e986cf9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:33.710528 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4df6e-8530-4027-ab10-510e986cf9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:33.710808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4df6e-8530-4027-ab10-510e986cf9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:33.711088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4df6e-8530-4027-ab10-510e986cf9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:33.719863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4df6e-8530-4027-ab10-510e986cf9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:33.721356 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4df6e-8530-4027-ab10-510e986cf9d4 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:33.730627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 670/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:38.362151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c72b23-afb1-489b-828f-2add99430a75 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:38.362646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c72b23-afb1-489b-828f-2add99430a75 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:38.362758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c72b23-afb1-489b-828f-2add99430a75 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:38.364091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 677/1347] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:38.369540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432393d-728c-4393-8909-46a9496e2e91 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:38.369987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432393d-728c-4393-8909-46a9496e2e91 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:38.370090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432393d-728c-4393-8909-46a9496e2e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:38.388169 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2432393d-728c-4393-8909-46a9496e2e91 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:38.390429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2432393d-728c-4393-8909-46a9496e2e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:38.397996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 671/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:38.434529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c72b23-afb1-489b-828f-2add99430a75 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:38.445854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c72b23-afb1-489b-828f-2add99430a75 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:38.449463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d47eb-9312-4485-a964-07255dbaee8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:38.450104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d47eb-9312-4485-a964-07255dbaee8e service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:38.450391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d47eb-9312-4485-a964-07255dbaee8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:38.450673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d47eb-9312-4485-a964-07255dbaee8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:38.460802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d47eb-9312-4485-a964-07255dbaee8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:38.462244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d47eb-9312-4485-a964-07255dbaee8e service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:38.471808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 678/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:43.672106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec203-1797-4ba3-8b8f-c4afe02c231e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:43.672669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec203-1797-4ba3-8b8f-c4afe02c231e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:43.672669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec203-1797-4ba3-8b8f-c4afe02c231e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:43.674053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 672/1350] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:43.679752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f54bf-c437-4dbb-afc5-2460531ce241 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:43.680152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f54bf-c437-4dbb-afc5-2460531ce241 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:43.680324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f54bf-c437-4dbb-afc5-2460531ce241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:43.787979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-592f54bf-c437-4dbb-afc5-2460531ce241 None None] MFA Rules not processed for user `257d9a088fa04cd5af48d6e4fb8b2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:43.787979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-592f54bf-c437-4dbb-afc5-2460531ce241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:43.885761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 679/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:14:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:47.965430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf255e-27cf-4d31-bc80-4811fe291588 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:47.965962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf255e-27cf-4d31-bc80-4811fe291588 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:47.966042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf255e-27cf-4d31-bc80-4811fe291588 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:47.967704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 673/1352] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:47.972877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6362-208e-4f8b-96de-0a56356aa963 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:47.973717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6362-208e-4f8b-96de-0a56356aa963 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:47.974218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6362-208e-4f8b-96de-0a56356aa963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:47.993202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-12bd6362-208e-4f8b-96de-0a56356aa963 None None] MFA Rules not processed for user `257d9a088fa04cd5af48d6e4fb8b2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:47.994391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-12bd6362-208e-4f8b-96de-0a56356aa963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:48.003343 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 680/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:14:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:48.384770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=66 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:49.697316 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566bed4-1044-4a1a-a129-264f8a5cb79c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:49.697971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566bed4-1044-4a1a-a129-264f8a5cb79c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:49.697971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566bed4-1044-4a1a-a129-264f8a5cb79c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:49.700137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 674/1354] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:49.705413 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb60db-7b27-4825-b6ee-94bceb8a21d4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:49.705858 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb60db-7b27-4825-b6ee-94bceb8a21d4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:49.706132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb60db-7b27-4825-b6ee-94bceb8a21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:49.725176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c4cb60db-7b27-4825-b6ee-94bceb8a21d4 None None] MFA Rules not processed for user `257d9a088fa04cd5af48d6e4fb8b2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:49.726461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c4cb60db-7b27-4825-b6ee-94bceb8a21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:49.734925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 681/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:14:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:53.518453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3569f-6d71-43a1-9a1b-02d0579f451b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:53.519942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3569f-6d71-43a1-9a1b-02d0579f451b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:53.521334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3569f-6d71-43a1-9a1b-02d0579f451b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:53.523637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 675/1356] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:53.529034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c36e40-0d1d-4481-b1e0-419be82dd589 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:53.529469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c36e40-0d1d-4481-b1e0-419be82dd589 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:53.529574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c36e40-0d1d-4481-b1e0-419be82dd589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:53.547935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-99c36e40-0d1d-4481-b1e0-419be82dd589 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:53.549153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-99c36e40-0d1d-4481-b1e0-419be82dd589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:53.557690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 682/1357] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:53.612268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00499481-db62-4471-9fe0-ef931fe8f4e5 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:53.612959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00499481-db62-4471-9fe0-ef931fe8f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:53.613479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00499481-db62-4471-9fe0-ef931fe8f4e5 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:53.615442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 676/1358] 10.222.0.15 () {54 vars in 961 bytes} [Thu May 26 03:14:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:53.622661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b8a54-1a73-415a-a051-c2b1bd40eadf None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:53.622942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b8a54-1a73-415a-a051-c2b1bd40eadf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:53.623262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b8a54-1a73-415a-a051-c2b1bd40eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:53.676675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-837b8a54-1a73-415a-a051-c2b1bd40eadf None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:53.678417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-837b8a54-1a73-415a-a051-c2b1bd40eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:53.684763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:14:53.768352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 683/1359] 10.222.0.15 () {58 vars in 1058 bytes} [Thu May 26 03:14:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:53.776503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00499481-db62-4471-9fe0-ef931fe8f4e5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:53.792696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00499481-db62-4471-9fe0-ef931fe8f4e5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:53.802682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc67ffa-9b66-4232-8976-1f18debb3040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:53.803345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc67ffa-9b66-4232-8976-1f18debb3040 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:53.803922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc67ffa-9b66-4232-8976-1f18debb3040 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:53.804250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc67ffa-9b66-4232-8976-1f18debb3040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:53.813804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc67ffa-9b66-4232-8976-1f18debb3040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:53.815665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc67ffa-9b66-4232-8976-1f18debb3040 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:53.826136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 677/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:56.248891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722ecf-d082-423d-b5cb-5d883659f27e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:56.249426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722ecf-d082-423d-b5cb-5d883659f27e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:56.249533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722ecf-d082-423d-b5cb-5d883659f27e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:56.250977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 684/1361] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:56.256769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddf8bd-057a-41d2-b4c9-69be399602eb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:56.257197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddf8bd-057a-41d2-b4c9-69be399602eb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:56.257338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddf8bd-057a-41d2-b4c9-69be399602eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:56.276019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-18ddf8bd-057a-41d2-b4c9-69be399602eb None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:56.277590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-18ddf8bd-057a-41d2-b4c9-69be399602eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:56.285640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 678/1362] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:56.330991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722ecf-d082-423d-b5cb-5d883659f27e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:56.348516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722ecf-d082-423d-b5cb-5d883659f27e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:56.354578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc6421-808b-44ea-8178-50ced12176f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:56.355219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc6421-808b-44ea-8178-50ced12176f2 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:56.355506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc6421-808b-44ea-8178-50ced12176f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:56.355916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc6421-808b-44ea-8178-50ced12176f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:56.366075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc6421-808b-44ea-8178-50ced12176f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:56.367885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc6421-808b-44ea-8178-50ced12176f2 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:56.378826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 685/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:14:58.974325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328cc8-2aa9-4ca4-9acd-8cecca45694d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:58.974854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328cc8-2aa9-4ca4-9acd-8cecca45694d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:58.974854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328cc8-2aa9-4ca4-9acd-8cecca45694d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:58.976234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 679/1364] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:14:58.981369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ca6f-70ea-44c7-a9af-9d3fde771590 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:58.981780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ca6f-70ea-44c7-a9af-9d3fde771590 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:58.981923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ca6f-70ea-44c7-a9af-9d3fde771590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:59.000108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dcb5ca6f-70ea-44c7-a9af-9d3fde771590 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:59.001389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dcb5ca6f-70ea-44c7-a9af-9d3fde771590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:59.013766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 686/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:59.063673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f03c-839a-4592-8d48-2db949bf650c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:59.063841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f03c-839a-4592-8d48-2db949bf650c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:59.064084 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f03c-839a-4592-8d48-2db949bf650c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:59.065507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 680/1366] 10.222.0.15 () {54 vars in 961 bytes} [Thu May 26 03:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:14:59.071504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afed090-a8f2-47af-8fb8-68595a74dfba None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:59.071796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afed090-a8f2-47af-8fb8-68595a74dfba None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:59.074826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afed090-a8f2-47af-8fb8-68595a74dfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:59.093234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9afed090-a8f2-47af-8fb8-68595a74dfba None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:14:59.094442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9afed090-a8f2-47af-8fb8-68595a74dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:14:59.109607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 687/1367] 10.222.0.15 () {58 vars in 1058 bytes} [Thu May 26 03:14:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:14:59.125488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f03c-839a-4592-8d48-2db949bf650c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:14:59.140253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f03c-839a-4592-8d48-2db949bf650c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:14:59.145834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d3c55-fdd5-4d35-a3ba-89470b1138a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:14:59.146475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d3c55-fdd5-4d35-a3ba-89470b1138a5 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:14:59.146764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d3c55-fdd5-4d35-a3ba-89470b1138a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:14:59.147547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d3c55-fdd5-4d35-a3ba-89470b1138a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:14:59.156000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d3c55-fdd5-4d35-a3ba-89470b1138a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:14:59.157639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d3c55-fdd5-4d35-a3ba-89470b1138a5 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:14:59.167648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 681/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:01.568567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a0e5-f398-445d-9370-1b132c37ce0a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:01.569145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a0e5-f398-445d-9370-1b132c37ce0a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:01.569145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a0e5-f398-445d-9370-1b132c37ce0a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:01.570468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 688/1369] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:01.575773 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94904f-7853-462a-8283-5ac2e067b224 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:01.576202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94904f-7853-462a-8283-5ac2e067b224 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:01.576345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94904f-7853-462a-8283-5ac2e067b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:01.594887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-da94904f-7853-462a-8283-5ac2e067b224 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:01.596081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-da94904f-7853-462a-8283-5ac2e067b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:01.604261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 682/1370] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:01.649175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a0e5-f398-445d-9370-1b132c37ce0a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:01.663996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a0e5-f398-445d-9370-1b132c37ce0a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:01.669467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fcc64-980a-4162-b2b4-61229960d9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:01.670122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fcc64-980a-4162-b2b4-61229960d9c6 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:01.670402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fcc64-980a-4162-b2b4-61229960d9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:01.670673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fcc64-980a-4162-b2b4-61229960d9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:01.679783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fcc64-980a-4162-b2b4-61229960d9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:01.681410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fcc64-980a-4162-b2b4-61229960d9c6 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:01.691037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 689/1371] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:01.803608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacdfc-921b-4efe-aa64-f55eff841661 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:01.804158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacdfc-921b-4efe-aa64-f55eff841661 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:01.804672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacdfc-921b-4efe-aa64-f55eff841661 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:01.806265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 683/1372] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:01.811780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24244bb-83db-4d92-8fb0-b59599ee0b63 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:01.812145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24244bb-83db-4d92-8fb0-b59599ee0b63 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:01.812550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24244bb-83db-4d92-8fb0-b59599ee0b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:01.832958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c24244bb-83db-4d92-8fb0-b59599ee0b63 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:01.834189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c24244bb-83db-4d92-8fb0-b59599ee0b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:01.842402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 690/1373] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:02.121833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48b4a0-9e22-4e78-bb4a-807f879b4fec None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:02.122115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48b4a0-9e22-4e78-bb4a-807f879b4fec None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:02.122581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48b4a0-9e22-4e78-bb4a-807f879b4fec None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:02.124105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 684/1374] 10.222.0.15 () {54 vars in 963 bytes} [Thu May 26 03:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:02.129247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3518eb-d51a-49e7-aa85-be3aea4852fa None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:02.129767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3518eb-d51a-49e7-aa85-be3aea4852fa None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:02.130208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3518eb-d51a-49e7-aa85-be3aea4852fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:02.179721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5b3518eb-d51a-49e7-aa85-be3aea4852fa None None] MFA Rules not processed for user `e479d9969f534788b2f35685e4e28da8`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:02.181214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5b3518eb-d51a-49e7-aa85-be3aea4852fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:02.242674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 691/1375] 10.222.0.15 () {58 vars in 1060 bytes} [Thu May 26 03:15:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:02.250390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48b4a0-9e22-4e78-bb4a-807f879b4fec None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:02.261730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48b4a0-9e22-4e78-bb4a-807f879b4fec None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:02.265568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd93a60-002c-4b9a-a920-99a0e355cee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:02.266393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93a60-002c-4b9a-a920-99a0e355cee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:02.266852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93a60-002c-4b9a-a920-99a0e355cee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:02.267293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93a60-002c-4b9a-a920-99a0e355cee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:02.277130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd93a60-002c-4b9a-a920-99a0e355cee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:02.278776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd93a60-002c-4b9a-a920-99a0e355cee3 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:02.300614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 685/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:04.012293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3fcb3-a1d6-441d-bc02-7f3e4c3e544d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:04.012947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3fcb3-a1d6-441d-bc02-7f3e4c3e544d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:04.013068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3fcb3-a1d6-441d-bc02-7f3e4c3e544d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:04.014714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 692/1377] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:04.020859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eae12-2920-44d8-b030-0afed7a40839 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:04.021383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eae12-2920-44d8-b030-0afed7a40839 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:04.021494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eae12-2920-44d8-b030-0afed7a40839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:04.041922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-de7eae12-2920-44d8-b030-0afed7a40839 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:04.043068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-de7eae12-2920-44d8-b030-0afed7a40839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:04.051105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 686/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:04.095852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3fcb3-a1d6-441d-bc02-7f3e4c3e544d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:04.111037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3fcb3-a1d6-441d-bc02-7f3e4c3e544d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:04.116746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a0cb2-7fbb-4c48-8cae-33693f222ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:04.117418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a0cb2-7fbb-4c48-8cae-33693f222ce7 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:04.117704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a0cb2-7fbb-4c48-8cae-33693f222ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:04.117980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a0cb2-7fbb-4c48-8cae-33693f222ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:04.127425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a0cb2-7fbb-4c48-8cae-33693f222ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:04.129073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a0cb2-7fbb-4c48-8cae-33693f222ce7 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:04.139326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 693/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:06.545594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ee783-0463-4774-80fe-45c3ca365062 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:06.546152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ee783-0463-4774-80fe-45c3ca365062 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:06.546152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ee783-0463-4774-80fe-45c3ca365062 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:06.547488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 687/1380] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:06.553229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4fb90-e380-4e01-b8d3-a2cad7693efe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:06.553642 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4fb90-e380-4e01-b8d3-a2cad7693efe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:06.553782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4fb90-e380-4e01-b8d3-a2cad7693efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:06.560935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:15:06.572285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-80f4fb90-e380-4e01-b8d3-a2cad7693efe None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:06.573501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-80f4fb90-e380-4e01-b8d3-a2cad7693efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:06.581728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 694/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:06.625271 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ee783-0463-4774-80fe-45c3ca365062 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:06.639510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ee783-0463-4774-80fe-45c3ca365062 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:06.644929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311e996-3646-4aa0-97f9-2bfafb69e423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:06.645585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311e996-3646-4aa0-97f9-2bfafb69e423 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:06.645865 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311e996-3646-4aa0-97f9-2bfafb69e423 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:06.646143 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311e996-3646-4aa0-97f9-2bfafb69e423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:06.654141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311e996-3646-4aa0-97f9-2bfafb69e423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:06.655709 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311e996-3646-4aa0-97f9-2bfafb69e423 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:06.665577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 688/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:08.983521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d183-f42e-4c48-a489-ca78e55c0332 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:08.984050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d183-f42e-4c48-a489-ca78e55c0332 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:08.984050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d183-f42e-4c48-a489-ca78e55c0332 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:08.985466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 695/1383] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:08.991834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f251-9749-4c45-ba78-00169daa863f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:08.992398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f251-9749-4c45-ba78-00169daa863f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:08.992494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f251-9749-4c45-ba78-00169daa863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:09.011208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6871f251-9749-4c45-ba78-00169daa863f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:09.016949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6871f251-9749-4c45-ba78-00169daa863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:09.021128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 689/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:09.062580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d183-f42e-4c48-a489-ca78e55c0332 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:09.078728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d183-f42e-4c48-a489-ca78e55c0332 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:09.084582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319abf4-89d1-4918-bc09-82b80f6c6886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:09.085487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319abf4-89d1-4918-bc09-82b80f6c6886 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:09.085872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319abf4-89d1-4918-bc09-82b80f6c6886 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:09.086255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319abf4-89d1-4918-bc09-82b80f6c6886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:09.095822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319abf4-89d1-4918-bc09-82b80f6c6886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:09.097737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319abf4-89d1-4918-bc09-82b80f6c6886 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:09.108581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 696/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:11.544055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38828db1-e827-4b55-af11-ce4df433d69c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:11.544604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38828db1-e827-4b55-af11-ce4df433d69c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:11.544803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38828db1-e827-4b55-af11-ce4df433d69c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:11.546568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 690/1386] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:11.552519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f00cc7-b010-40dc-ac19-0f078ffb2136 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:11.552940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f00cc7-b010-40dc-ac19-0f078ffb2136 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:11.553093 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f00cc7-b010-40dc-ac19-0f078ffb2136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:11.571393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d9f00cc7-b010-40dc-ac19-0f078ffb2136 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:11.572633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d9f00cc7-b010-40dc-ac19-0f078ffb2136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:11.580736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 697/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:11.625206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38828db1-e827-4b55-af11-ce4df433d69c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:11.642383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38828db1-e827-4b55-af11-ce4df433d69c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:11.647915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb92ac-b247-4450-b44c-abc7a99869f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:11.648592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb92ac-b247-4450-b44c-abc7a99869f7 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:11.648875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb92ac-b247-4450-b44c-abc7a99869f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:11.649150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb92ac-b247-4450-b44c-abc7a99869f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:11.657462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb92ac-b247-4450-b44c-abc7a99869f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:11.659059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb92ac-b247-4450-b44c-abc7a99869f7 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:11.668479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 691/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:14.235034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458a33e-1cd1-4359-af7e-195576d275d6 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:14.235679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458a33e-1cd1-4359-af7e-195576d275d6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:14.235679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458a33e-1cd1-4359-af7e-195576d275d6 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:14.236945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 698/1389] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:14.242301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46a2af-29c3-4866-9a99-a2a8b5153e6b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:14.242779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46a2af-29c3-4866-9a99-a2a8b5153e6b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:14.242929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46a2af-29c3-4866-9a99-a2a8b5153e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:14.260823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bf46a2af-29c3-4866-9a99-a2a8b5153e6b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:14.262039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bf46a2af-29c3-4866-9a99-a2a8b5153e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:14.270512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 692/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:14.314054 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458a33e-1cd1-4359-af7e-195576d275d6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:14.333566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458a33e-1cd1-4359-af7e-195576d275d6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:14.340610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a330f6-28cc-4e7e-b5c2-c49ca69b80ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:14.341804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a330f6-28cc-4e7e-b5c2-c49ca69b80ab service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:14.342166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a330f6-28cc-4e7e-b5c2-c49ca69b80ab service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:14.342513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a330f6-28cc-4e7e-b5c2-c49ca69b80ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:14.353136 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a330f6-28cc-4e7e-b5c2-c49ca69b80ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:14.355159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a330f6-28cc-4e7e-b5c2-c49ca69b80ab service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:14.366605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 699/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:16.995891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469023e6-f441-4aa3-a1f0-62f23e79de95 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:16.996537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469023e6-f441-4aa3-a1f0-62f23e79de95 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:16.996537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469023e6-f441-4aa3-a1f0-62f23e79de95 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:16.997943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 693/1392] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:17.003381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64ff00-8a0c-41d7-ac70-15569f8040f7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:17.003858 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64ff00-8a0c-41d7-ac70-15569f8040f7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:17.003969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64ff00-8a0c-41d7-ac70-15569f8040f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:17.022474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9f64ff00-8a0c-41d7-ac70-15569f8040f7 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:17.023667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9f64ff00-8a0c-41d7-ac70-15569f8040f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:17.031431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 700/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:17.076338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469023e6-f441-4aa3-a1f0-62f23e79de95 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:17.092411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469023e6-f441-4aa3-a1f0-62f23e79de95 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:17.098884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d38c86-3099-4d72-bc89-ffab1209977f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:17.099616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d38c86-3099-4d72-bc89-ffab1209977f service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:17.099900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d38c86-3099-4d72-bc89-ffab1209977f service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:17.100199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d38c86-3099-4d72-bc89-ffab1209977f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:17.109265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d38c86-3099-4d72-bc89-ffab1209977f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:17.110871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d38c86-3099-4d72-bc89-ffab1209977f service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:17.120395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 694/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:18.184462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0fe36-305f-40d0-a5fb-b5fb3a98d1cc None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:18.184988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0fe36-305f-40d0-a5fb-b5fb3a98d1cc None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:18.184988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0fe36-305f-40d0-a5fb-b5fb3a98d1cc None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:18.186334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 701/1395] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:18.192570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f62cd-555a-4c16-a3e7-1e8f8b7d76ba None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:18.192982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f62cd-555a-4c16-a3e7-1e8f8b7d76ba None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:18.193287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f62cd-555a-4c16-a3e7-1e8f8b7d76ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:18.211380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d98f62cd-555a-4c16-a3e7-1e8f8b7d76ba None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:18.212601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d98f62cd-555a-4c16-a3e7-1e8f8b7d76ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:18.220479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 695/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:18.275171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d8b8f-527d-4773-810d-497a542d04dd None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:18.275467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d8b8f-527d-4773-810d-497a542d04dd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:18.275749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d8b8f-527d-4773-810d-497a542d04dd None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:18.277152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 702/1397] 10.222.0.15 () {54 vars in 962 bytes} [Thu May 26 03:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:18.282253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb06d-5e48-42d4-9784-8fdca81ffe44 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:18.282552 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb06d-5e48-42d4-9784-8fdca81ffe44 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:18.282859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdb06d-5e48-42d4-9784-8fdca81ffe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:18.330414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1bcdb06d-5e48-42d4-9784-8fdca81ffe44 None None] MFA Rules not processed for user `99b95fdb06a94c1586148df32413085f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:18.331595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1bcdb06d-5e48-42d4-9784-8fdca81ffe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:18.392810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 696/1398] 10.222.0.15 () {58 vars in 1059 bytes} [Thu May 26 03:15:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:18.401033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d8b8f-527d-4773-810d-497a542d04dd None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:18.412263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d8b8f-527d-4773-810d-497a542d04dd None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:18.415741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb44e0-dceb-4840-a6c0-114e70c21da6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b95fdb06a94c1586148df32413085f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:18.416407 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb44e0-dceb-4840-a6c0-114e70c21da6 service glance] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:18.416699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb44e0-dceb-4840-a6c0-114e70c21da6 service glance] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:18.416967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb44e0-dceb-4840-a6c0-114e70c21da6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:18.425830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb44e0-dceb-4840-a6c0-114e70c21da6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:18.427256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb44e0-dceb-4840-a6c0-114e70c21da6 service glance] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:18.437029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 703/1399] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:19.086421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13847652-d3ef-4029-8c5a-f7c0f21b48d2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:19.086714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13847652-d3ef-4029-8c5a-f7c0f21b48d2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:19.086996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13847652-d3ef-4029-8c5a-f7c0f21b48d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:19.092186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:15:19.137081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-13847652-d3ef-4029-8c5a-f7c0f21b48d2 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:19.138269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13847652-d3ef-4029-8c5a-f7c0f21b48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:19.201793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 697/1400] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:15:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:19.241133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b362baa-7702-4736-87b9-503083b3e36f None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:19.241603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b362baa-7702-4736-87b9-503083b3e36f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:19.241694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b362baa-7702-4736-87b9-503083b3e36f None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:19.243060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 704/1401] 10.222.0.15 () {54 vars in 942 bytes} [Thu May 26 03:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:19.249553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157fd0b-7652-49a3-bb30-e70046ae1bb9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:19.249846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157fd0b-7652-49a3-bb30-e70046ae1bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:19.250126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157fd0b-7652-49a3-bb30-e70046ae1bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:19.303933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d157fd0b-7652-49a3-bb30-e70046ae1bb9 None None] MFA Rules not processed for user `80bd57e333be4921b6270b54a1fac2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:19.305159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d157fd0b-7652-49a3-bb30-e70046ae1bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:19.376047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 698/1402] 10.222.0.15 () {58 vars in 1039 bytes} [Thu May 26 03:15:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:19.385152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b362baa-7702-4736-87b9-503083b3e36f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:19.398524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b362baa-7702-4736-87b9-503083b3e36f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:19.403393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae23d6-e7b2-43a5-877c-7ad4092aa87a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:19.404033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae23d6-e7b2-43a5-877c-7ad4092aa87a service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:19.404322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae23d6-e7b2-43a5-877c-7ad4092aa87a service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:19.404609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae23d6-e7b2-43a5-877c-7ad4092aa87a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:19.413156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae23d6-e7b2-43a5-877c-7ad4092aa87a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:19.414716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae23d6-e7b2-43a5-877c-7ad4092aa87a service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:19.422845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 705/1403] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:15:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:15:19.459799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374fcc-bc78-4c62-8a9a-8f9a60ffa199 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:19.460119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374fcc-bc78-4c62-8a9a-8f9a60ffa199 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:19.460447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374fcc-bc78-4c62-8a9a-8f9a60ffa199 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:19.461826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 699/1404] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:19.467168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977609-d670-4663-b5ed-c0d01a8116e5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:19.467408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977609-d670-4663-b5ed-c0d01a8116e5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:19.474117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977609-d670-4663-b5ed-c0d01a8116e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:19.486828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-98977609-d670-4663-b5ed-c0d01a8116e5 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:19.488017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-98977609-d670-4663-b5ed-c0d01a8116e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:19.496447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 706/1405] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:19.540696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374fcc-bc78-4c62-8a9a-8f9a60ffa199 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:19.555497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374fcc-bc78-4c62-8a9a-8f9a60ffa199 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:19.560839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149b4c0-84dd-494f-8854-22668b3044d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:19.561469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149b4c0-84dd-494f-8854-22668b3044d7 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:19.561753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149b4c0-84dd-494f-8854-22668b3044d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:19.562027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149b4c0-84dd-494f-8854-22668b3044d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:19.570454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149b4c0-84dd-494f-8854-22668b3044d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:19.575161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149b4c0-84dd-494f-8854-22668b3044d7 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:19.581880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 700/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:22.083907 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7208-eb36-4a92-b748-1e86cac126e1 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:22.084453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7208-eb36-4a92-b748-1e86cac126e1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:22.084453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7208-eb36-4a92-b748-1e86cac126e1 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:22.085840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 707/1407] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:22.091389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7cb0-6a1b-4a64-a59e-f755584fb732 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:22.091843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7cb0-6a1b-4a64-a59e-f755584fb732 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:22.091949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7cb0-6a1b-4a64-a59e-f755584fb732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:22.112281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-595b7cb0-6a1b-4a64-a59e-f755584fb732 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:22.114372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-595b7cb0-6a1b-4a64-a59e-f755584fb732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:22.122815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 701/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:22.172384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7208-eb36-4a92-b748-1e86cac126e1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:22.191014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7208-eb36-4a92-b748-1e86cac126e1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:22.197491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea341-ece3-49b5-bec9-7dacd036d02b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:22.198141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea341-ece3-49b5-bec9-7dacd036d02b service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:22.198416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea341-ece3-49b5-bec9-7dacd036d02b service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:22.198826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea341-ece3-49b5-bec9-7dacd036d02b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:22.208189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ea341-ece3-49b5-bec9-7dacd036d02b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:22.209817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ea341-ece3-49b5-bec9-7dacd036d02b service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:22.219518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 708/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:32.127497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:15:32.285867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=40 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:15:43.788600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da2a03-96af-451b-a3d1-1bf8d0b97c98 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:43.789180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da2a03-96af-451b-a3d1-1bf8d0b97c98 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:43.789180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da2a03-96af-451b-a3d1-1bf8d0b97c98 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:43.790574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 702/1410] 10.222.0.15 () {54 vars in 918 bytes} [Thu May 26 03:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:43.795814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6875856-3984-4f25-8bec-1b645823cbb7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:43.796263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6875856-3984-4f25-8bec-1b645823cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:43.796427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6875856-3984-4f25-8bec-1b645823cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:43.814472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c6875856-3984-4f25-8bec-1b645823cbb7 None None] MFA Rules not processed for user `257d9a088fa04cd5af48d6e4fb8b2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:43.815663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c6875856-3984-4f25-8bec-1b645823cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:43.824176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 709/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Thu May 26 03:15:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:15:43.838834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154c2e-5d9d-460a-b71e-a3c68175dcd4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:43.839123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154c2e-5d9d-460a-b71e-a3c68175dcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:43.839404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154c2e-5d9d-460a-b71e-a3c68175dcd4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:43.840803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 703/1412] 10.222.0.15 () {54 vars in 918 bytes} [Thu May 26 03:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:43.845314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a3c9d-56af-4f1f-ab32-8af0ff0f3a5b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:43.845602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a3c9d-56af-4f1f-ab32-8af0ff0f3a5b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:43.845879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a3c9d-56af-4f1f-ab32-8af0ff0f3a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:43.863811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9f3a3c9d-56af-4f1f-ab32-8af0ff0f3a5b None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:43.865041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9f3a3c9d-56af-4f1f-ab32-8af0ff0f3a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:43.873905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 710/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Thu May 26 03:15:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:46.504479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b446da-c90b-49af-acec-84f1f8efba3d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:46.505114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b446da-c90b-49af-acec-84f1f8efba3d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:46.505114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b446da-c90b-49af-acec-84f1f8efba3d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:46.506457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:46.511786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6b655-08bc-4d7a-a8b5-6f435267ce4b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:46.512224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6b655-08bc-4d7a-a8b5-6f435267ce4b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:46.512444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6b655-08bc-4d7a-a8b5-6f435267ce4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:46.530050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-03b6b655-08bc-4d7a-a8b5-6f435267ce4b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:46.531221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-03b6b655-08bc-4d7a-a8b5-6f435267ce4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:46.539407 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:46.581211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b446da-c90b-49af-acec-84f1f8efba3d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:46.595324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b446da-c90b-49af-acec-84f1f8efba3d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:46.601209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06e6b8-5d31-4169-96bd-2cb0dd32cf07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:46.601835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06e6b8-5d31-4169-96bd-2cb0dd32cf07 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:46.602113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06e6b8-5d31-4169-96bd-2cb0dd32cf07 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:46.602383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06e6b8-5d31-4169-96bd-2cb0dd32cf07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:46.610338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06e6b8-5d31-4169-96bd-2cb0dd32cf07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:46.611912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06e6b8-5d31-4169-96bd-2cb0dd32cf07 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:46.621829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 705/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:47.583586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565077d-7e1c-4da8-a39c-c6f32f752854 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:47.584029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565077d-7e1c-4da8-a39c-c6f32f752854 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:47.584163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565077d-7e1c-4da8-a39c-c6f32f752854 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:47.585559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:47.590465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8427282-1c0e-49f9-9113-c693c17a9d9e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:47.590886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8427282-1c0e-49f9-9113-c693c17a9d9e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:47.591019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8427282-1c0e-49f9-9113-c693c17a9d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:47.609164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c8427282-1c0e-49f9-9113-c693c17a9d9e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:47.610351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c8427282-1c0e-49f9-9113-c693c17a9d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:47.618036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:47.775149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565077d-7e1c-4da8-a39c-c6f32f752854 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:47.789940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565077d-7e1c-4da8-a39c-c6f32f752854 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:47.795367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df319ca-550d-497f-8eab-62a66836141d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:47.796018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df319ca-550d-497f-8eab-62a66836141d service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:47.796376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df319ca-550d-497f-8eab-62a66836141d service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:47.796614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df319ca-550d-497f-8eab-62a66836141d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:47.804864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df319ca-550d-497f-8eab-62a66836141d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:47.806451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df319ca-550d-497f-8eab-62a66836141d service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:47.815719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 713/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:48.731281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fa3f5-564b-4fc5-af89-9b98bc3f0daa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:48.731851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fa3f5-564b-4fc5-af89-9b98bc3f0daa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:48.731851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fa3f5-564b-4fc5-af89-9b98bc3f0daa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:48.733264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:48.738790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535825d-ab8b-427f-909a-d93ad08fb892 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:48.739237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535825d-ab8b-427f-909a-d93ad08fb892 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:48.739365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535825d-ab8b-427f-909a-d93ad08fb892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:48.757036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a535825d-ab8b-427f-909a-d93ad08fb892 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:48.758254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a535825d-ab8b-427f-909a-d93ad08fb892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:48.765915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:48.916919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fa3f5-564b-4fc5-af89-9b98bc3f0daa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:48.931462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fa3f5-564b-4fc5-af89-9b98bc3f0daa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:48.936818 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e080649-a4c5-4d56-bdc4-beb5724a4abd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:48.937453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e080649-a4c5-4d56-bdc4-beb5724a4abd service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:48.937737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e080649-a4c5-4d56-bdc4-beb5724a4abd service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:48.938013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e080649-a4c5-4d56-bdc4-beb5724a4abd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:48.945986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e080649-a4c5-4d56-bdc4-beb5724a4abd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:48.947804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e080649-a4c5-4d56-bdc4-beb5724a4abd service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:48.958885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 708/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:49.855539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6ada-70ae-47f1-ac06-773708ce6857 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:49.856053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6ada-70ae-47f1-ac06-773708ce6857 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:49.856168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6ada-70ae-47f1-ac06-773708ce6857 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:49.857479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:49.862443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e8b1-9800-4f1a-9711-3e87690a524c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:49.862827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e8b1-9800-4f1a-9711-3e87690a524c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:49.863052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e8b1-9800-4f1a-9711-3e87690a524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:49.880758 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a291e8b1-9800-4f1a-9711-3e87690a524c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:49.881941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a291e8b1-9800-4f1a-9711-3e87690a524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:49.889675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:50.037822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6ada-70ae-47f1-ac06-773708ce6857 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:50.051886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6ada-70ae-47f1-ac06-773708ce6857 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:50.057175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d566ad-3cc8-4148-82c5-6ea9a7a2a295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:50.057800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d566ad-3cc8-4148-82c5-6ea9a7a2a295 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:50.058083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d566ad-3cc8-4148-82c5-6ea9a7a2a295 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:50.058357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d566ad-3cc8-4148-82c5-6ea9a7a2a295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:50.066258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d566ad-3cc8-4148-82c5-6ea9a7a2a295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:50.067824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d566ad-3cc8-4148-82c5-6ea9a7a2a295 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:50.077244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 716/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:50.967982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e42f5-ac68-4cca-823f-b8ea1200dece None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:50.968572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e42f5-ac68-4cca-823f-b8ea1200dece None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:50.968572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e42f5-ac68-4cca-823f-b8ea1200dece None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:50.969944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:50.975411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674c07e-54e9-44ba-ab31-c4fb390f934b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:50.975898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674c07e-54e9-44ba-ab31-c4fb390f934b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:50.976255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674c07e-54e9-44ba-ab31-c4fb390f934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:50.995534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8674c07e-54e9-44ba-ab31-c4fb390f934b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:50.996753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8674c07e-54e9-44ba-ab31-c4fb390f934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:51.004368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:51.152844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e42f5-ac68-4cca-823f-b8ea1200dece None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:51.167330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e42f5-ac68-4cca-823f-b8ea1200dece None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:51.172746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04be42-116c-41a7-a6d1-67b28c817936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:51.173375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04be42-116c-41a7-a6d1-67b28c817936 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:51.173657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04be42-116c-41a7-a6d1-67b28c817936 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:51.173932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04be42-116c-41a7-a6d1-67b28c817936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:51.182717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04be42-116c-41a7-a6d1-67b28c817936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:51.184373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04be42-116c-41a7-a6d1-67b28c817936 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:51.193581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 711/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:52.069216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fbd6d-09fc-4f1f-8661-ec90b813ce3e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:52.069754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fbd6d-09fc-4f1f-8661-ec90b813ce3e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:52.069754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fbd6d-09fc-4f1f-8661-ec90b813ce3e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:52.071052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:52.075857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997aae-390c-4c9b-b416-e93e0c2fc6de None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:52.076536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997aae-390c-4c9b-b416-e93e0c2fc6de None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:52.076728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997aae-390c-4c9b-b416-e93e0c2fc6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:52.094879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5e997aae-390c-4c9b-b416-e93e0c2fc6de None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:52.096080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5e997aae-390c-4c9b-b416-e93e0c2fc6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:52.104429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:52.249832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fbd6d-09fc-4f1f-8661-ec90b813ce3e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:52.263836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fbd6d-09fc-4f1f-8661-ec90b813ce3e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:52.269681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4cd18-6783-4084-a105-b8bc1e55007a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:52.270307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4cd18-6783-4084-a105-b8bc1e55007a service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:52.270589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4cd18-6783-4084-a105-b8bc1e55007a service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:52.270863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4cd18-6783-4084-a105-b8bc1e55007a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:52.278828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4cd18-6783-4084-a105-b8bc1e55007a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:52.280412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4cd18-6783-4084-a105-b8bc1e55007a service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:52.290176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 719/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:53.199760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e57957-6c36-4c07-83df-c89a0aacb1a8 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:53.200321 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e57957-6c36-4c07-83df-c89a0aacb1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:53.200321 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e57957-6c36-4c07-83df-c89a0aacb1a8 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:53.201929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:53.207308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f9b5-56b5-4dd7-9619-0b2959ef3dc7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:53.207738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f9b5-56b5-4dd7-9619-0b2959ef3dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:53.207848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f9b5-56b5-4dd7-9619-0b2959ef3dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:53.225628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4421f9b5-56b5-4dd7-9619-0b2959ef3dc7 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:53.226814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4421f9b5-56b5-4dd7-9619-0b2959ef3dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:53.234503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:53.383180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e57957-6c36-4c07-83df-c89a0aacb1a8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:53.397849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e57957-6c36-4c07-83df-c89a0aacb1a8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:53.403211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c84a39-60cf-41e0-9b2f-b278c301daf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:53.403843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c84a39-60cf-41e0-9b2f-b278c301daf5 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:53.404133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c84a39-60cf-41e0-9b2f-b278c301daf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:53.404447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c84a39-60cf-41e0-9b2f-b278c301daf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:53.412458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c84a39-60cf-41e0-9b2f-b278c301daf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:53.414055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c84a39-60cf-41e0-9b2f-b278c301daf5 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:53.423283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 714/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:54.327423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e897caf-e40c-4312-8be9-8935ae6e5a11 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:54.327989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e897caf-e40c-4312-8be9-8935ae6e5a11 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:54.327989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e897caf-e40c-4312-8be9-8935ae6e5a11 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:54.329367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:54.334697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f18a7-3ee0-495b-96b9-3ce80598b0f4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:54.335122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f18a7-3ee0-495b-96b9-3ce80598b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:54.335234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f18a7-3ee0-495b-96b9-3ce80598b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:54.353393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3b8f18a7-3ee0-495b-96b9-3ce80598b0f4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:54.354569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3b8f18a7-3ee0-495b-96b9-3ce80598b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:54.362144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:54.512571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e897caf-e40c-4312-8be9-8935ae6e5a11 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:54.527212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e897caf-e40c-4312-8be9-8935ae6e5a11 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:54.532471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f8ca7-6e8d-444b-8452-d19b451d9433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:54.533099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f8ca7-6e8d-444b-8452-d19b451d9433 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:54.533377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f8ca7-6e8d-444b-8452-d19b451d9433 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:54.533651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f8ca7-6e8d-444b-8452-d19b451d9433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:54.542041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f8ca7-6e8d-444b-8452-d19b451d9433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:54.543593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f8ca7-6e8d-444b-8452-d19b451d9433 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:54.552714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 722/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:55.448326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eecce5-65a3-4657-9c2d-d09401dd9826 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:55.448849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eecce5-65a3-4657-9c2d-d09401dd9826 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:55.448964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eecce5-65a3-4657-9c2d-d09401dd9826 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:55.450272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:55.455576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f874bb-fd5e-4c29-bf80-9af5b7e22ed3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:55.455978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f874bb-fd5e-4c29-bf80-9af5b7e22ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:55.456128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f874bb-fd5e-4c29-bf80-9af5b7e22ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:55.474206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-53f874bb-fd5e-4c29-bf80-9af5b7e22ed3 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:55.475370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-53f874bb-fd5e-4c29-bf80-9af5b7e22ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:55.483020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:15:55.631273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eecce5-65a3-4657-9c2d-d09401dd9826 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:55.645267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eecce5-65a3-4657-9c2d-d09401dd9826 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:55.650577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b0570-7e36-4595-8f70-1600bceb8496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:55.651248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b0570-7e36-4595-8f70-1600bceb8496 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:55.651529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b0570-7e36-4595-8f70-1600bceb8496 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:55.651807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b0570-7e36-4595-8f70-1600bceb8496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:55.660505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b0570-7e36-4595-8f70-1600bceb8496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:55.661934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b0570-7e36-4595-8f70-1600bceb8496 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:55.671010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 717/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:15:57.731144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7cc0-92fa-4d82-8e83-0d00405c1768 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:57.731144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7cc0-92fa-4d82-8e83-0d00405c1768 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:57.731144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7cc0-92fa-4d82-8e83-0d00405c1768 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:57.732412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:15:57.737888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece157-8fad-454c-9785-5ff05d272e2a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:57.738327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece157-8fad-454c-9785-5ff05d272e2a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:57.738418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece157-8fad-454c-9785-5ff05d272e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:57.756424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e0ece157-8fad-454c-9785-5ff05d272e2a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:15:57.757619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e0ece157-8fad-454c-9785-5ff05d272e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:15:57.765349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:15:57.803069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7cc0-92fa-4d82-8e83-0d00405c1768 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:15:57.813605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7cc0-92fa-4d82-8e83-0d00405c1768 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:15:57.817567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b7ba8-db2e-42dc-b9f5-d46d3510bd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:15:57.818201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b7ba8-db2e-42dc-b9f5-d46d3510bd9f service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:15:57.818484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b7ba8-db2e-42dc-b9f5-d46d3510bd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:15:57.818760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b7ba8-db2e-42dc-b9f5-d46d3510bd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:15:57.827588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b7ba8-db2e-42dc-b9f5-d46d3510bd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:15:57.829042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b7ba8-db2e-42dc-b9f5-d46d3510bd9f service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:15:57.838793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 725/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:00.164578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280705ba-744b-4202-bf92-bccfa385560d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:00.165107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280705ba-744b-4202-bf92-bccfa385560d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:00.165107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280705ba-744b-4202-bf92-bccfa385560d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:00.166431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:00.171800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756f3a-29cd-4c74-8198-cbad1fc094fc None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:00.172215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756f3a-29cd-4c74-8198-cbad1fc094fc None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:00.172379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f756f3a-29cd-4c74-8198-cbad1fc094fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:00.190293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7f756f3a-29cd-4c74-8198-cbad1fc094fc None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:00.191470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7f756f3a-29cd-4c74-8198-cbad1fc094fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:00.199074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:00.236905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280705ba-744b-4202-bf92-bccfa385560d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:00.247381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280705ba-744b-4202-bf92-bccfa385560d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:00.250871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93accccd-4d84-443f-b55d-e6d0164fe3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:00.251503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93accccd-4d84-443f-b55d-e6d0164fe3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:00.251788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93accccd-4d84-443f-b55d-e6d0164fe3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:00.252064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93accccd-4d84-443f-b55d-e6d0164fe3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:00.260787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93accccd-4d84-443f-b55d-e6d0164fe3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:00.262215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93accccd-4d84-443f-b55d-e6d0164fe3f8 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:00.271915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 720/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:02.788637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b011f96-8599-43b8-a665-7f199aa6439b None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:02.789166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b011f96-8599-43b8-a665-7f199aa6439b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:02.789259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b011f96-8599-43b8-a665-7f199aa6439b None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:02.790590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:02.796185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d47cdb-76e5-43ab-9ff1-903e8e281464 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:02.796777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d47cdb-76e5-43ab-9ff1-903e8e281464 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:02.796777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d47cdb-76e5-43ab-9ff1-903e8e281464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:02.815291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e2d47cdb-76e5-43ab-9ff1-903e8e281464 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:02.816520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e2d47cdb-76e5-43ab-9ff1-903e8e281464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:02.824216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:02.863029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b011f96-8599-43b8-a665-7f199aa6439b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:02.873585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b011f96-8599-43b8-a665-7f199aa6439b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:02.877057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89a73b-4c00-438a-9743-e3c251000393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:02.878196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89a73b-4c00-438a-9743-e3c251000393 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:02.878482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89a73b-4c00-438a-9743-e3c251000393 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:02.878755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89a73b-4c00-438a-9743-e3c251000393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:02.887391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89a73b-4c00-438a-9743-e3c251000393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:02.888856 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89a73b-4c00-438a-9743-e3c251000393 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:02.898608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 728/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:05.295452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c2b8-b170-4f3d-9fa3-98b420695f1d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:05.296110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c2b8-b170-4f3d-9fa3-98b420695f1d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:05.296110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c2b8-b170-4f3d-9fa3-98b420695f1d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:05.297407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:05.302760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7c97b-495b-4553-b5c2-18168aeb3c38 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:05.303204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7c97b-495b-4553-b5c2-18168aeb3c38 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:05.303363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7c97b-495b-4553-b5c2-18168aeb3c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:05.321620 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-30d7c97b-495b-4553-b5c2-18168aeb3c38 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:05.325061 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-30d7c97b-495b-4553-b5c2-18168aeb3c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:05.331849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:05.368889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48c2b8-b170-4f3d-9fa3-98b420695f1d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:05.379881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48c2b8-b170-4f3d-9fa3-98b420695f1d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:05.383382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f8856-4167-4c8e-95cd-3afacb3130c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:05.384017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8856-4167-4c8e-95cd-3afacb3130c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:05.384298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8856-4167-4c8e-95cd-3afacb3130c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:05.384609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8856-4167-4c8e-95cd-3afacb3130c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:05.393920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f8856-4167-4c8e-95cd-3afacb3130c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:05.395362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f8856-4167-4c8e-95cd-3afacb3130c8 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:05.404663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 723/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:07.624442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7a155-51a2-4f93-a884-ca798a42fb28 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:07.624921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7a155-51a2-4f93-a884-ca798a42fb28 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:07.625037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7a155-51a2-4f93-a884-ca798a42fb28 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:07.626379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:07.631920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e08b6-bb8a-405a-8a70-193354f1450a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:07.632449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e08b6-bb8a-405a-8a70-193354f1450a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:07.632552 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e08b6-bb8a-405a-8a70-193354f1450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:07.649819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ad5e08b6-bb8a-405a-8a70-193354f1450a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:07.651005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ad5e08b6-bb8a-405a-8a70-193354f1450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:07.659220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:07.696385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7a155-51a2-4f93-a884-ca798a42fb28 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:07.707734 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7a155-51a2-4f93-a884-ca798a42fb28 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:07.711253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc35c7-15b4-4aed-ad3e-d0f45202cf9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:07.711885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc35c7-15b4-4aed-ad3e-d0f45202cf9e service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:07.712171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc35c7-15b4-4aed-ad3e-d0f45202cf9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:07.712483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc35c7-15b4-4aed-ad3e-d0f45202cf9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:07.721754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc35c7-15b4-4aed-ad3e-d0f45202cf9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:07.723177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc35c7-15b4-4aed-ad3e-d0f45202cf9e service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:07.732534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 731/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:09.949923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2b2a-3136-40f7-a8f6-8e5940524abe None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:09.950443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2b2a-3136-40f7-a8f6-8e5940524abe None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:09.950443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2b2a-3136-40f7-a8f6-8e5940524abe None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:09.952029 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:09.958004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889bbcb-25f0-4f25-bff3-a221cb157ec8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:09.958410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889bbcb-25f0-4f25-bff3-a221cb157ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:09.958608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889bbcb-25f0-4f25-bff3-a221cb157ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:09.976198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6889bbcb-25f0-4f25-bff3-a221cb157ec8 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:09.980630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6889bbcb-25f0-4f25-bff3-a221cb157ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:09.985265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:10.023160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2b2a-3136-40f7-a8f6-8e5940524abe None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:10.033797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2b2a-3136-40f7-a8f6-8e5940524abe None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:10.037314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d3261-8eb0-4ad6-b9a4-ab75adaee58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:10.037945 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d3261-8eb0-4ad6-b9a4-ab75adaee58e service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:10.038226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d3261-8eb0-4ad6-b9a4-ab75adaee58e service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:10.038503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d3261-8eb0-4ad6-b9a4-ab75adaee58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:10.047209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d3261-8eb0-4ad6-b9a4-ab75adaee58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:10.048681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d3261-8eb0-4ad6-b9a4-ab75adaee58e service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:10.058286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 726/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:12.274767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffcdd2-5308-4fa8-b5cf-360252d909b9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:12.275346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffcdd2-5308-4fa8-b5cf-360252d909b9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:12.275346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffcdd2-5308-4fa8-b5cf-360252d909b9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:12.276701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:12.282063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a6fa-7c90-4ef4-9120-1e321e246842 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:12.282450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a6fa-7c90-4ef4-9120-1e321e246842 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:12.282622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a6fa-7c90-4ef4-9120-1e321e246842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:12.300808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c8b3a6fa-7c90-4ef4-9120-1e321e246842 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:12.301997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c8b3a6fa-7c90-4ef4-9120-1e321e246842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:12.309775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:12.347070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffcdd2-5308-4fa8-b5cf-360252d909b9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:12.357442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffcdd2-5308-4fa8-b5cf-360252d909b9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:12.360869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72a4f3-3cc9-480b-80d3-011a750b11f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:12.361500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72a4f3-3cc9-480b-80d3-011a750b11f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:12.361777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72a4f3-3cc9-480b-80d3-011a750b11f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:12.362050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72a4f3-3cc9-480b-80d3-011a750b11f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:12.370594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72a4f3-3cc9-480b-80d3-011a750b11f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:12.372002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72a4f3-3cc9-480b-80d3-011a750b11f3 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:12.381201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 734/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:14.592541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd905-a567-48ef-be30-e77192b4e761 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:14.593110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd905-a567-48ef-be30-e77192b4e761 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:14.593110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd905-a567-48ef-be30-e77192b4e761 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:14.594479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:14.599784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744582-74dd-4fff-86c0-76d947398e1a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:14.600196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744582-74dd-4fff-86c0-76d947398e1a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:14.600374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744582-74dd-4fff-86c0-76d947398e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:14.606417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=79 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:16:14.618986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-39744582-74dd-4fff-86c0-76d947398e1a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:14.625761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-39744582-74dd-4fff-86c0-76d947398e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:14.628882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:14.665657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd905-a567-48ef-be30-e77192b4e761 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:14.667307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c1cd905-a567-48ef-be30-e77192b4e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:14.675366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=73 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:16:14.680989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd905-a567-48ef-be30-e77192b4e761 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:14.685476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594adea-51af-4bab-98f2-ba96e4f42d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:14.685476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594adea-51af-4bab-98f2-ba96e4f42d2b service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:14.685694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594adea-51af-4bab-98f2-ba96e4f42d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:14.685832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594adea-51af-4bab-98f2-ba96e4f42d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:14.695490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594adea-51af-4bab-98f2-ba96e4f42d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:14.696960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594adea-51af-4bab-98f2-ba96e4f42d2b service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:14.706696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 729/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:16.924790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31491e-076c-4522-9111-27a225b71d8a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:16.938735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31491e-076c-4522-9111-27a225b71d8a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:16.938735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31491e-076c-4522-9111-27a225b71d8a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:16.938735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:16.939044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ba34-c1e8-4b90-a999-c49fa525f24a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:16.939044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ba34-c1e8-4b90-a999-c49fa525f24a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:16.939044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ba34-c1e8-4b90-a999-c49fa525f24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:16.951555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f5c8ba34-c1e8-4b90-a999-c49fa525f24a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:16.952768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f5c8ba34-c1e8-4b90-a999-c49fa525f24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:16.960633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:16.996550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31491e-076c-4522-9111-27a225b71d8a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:17.007900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31491e-076c-4522-9111-27a225b71d8a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:17.011423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a0a9-d9b8-4945-bce4-e51065f378ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:17.012050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a0a9-d9b8-4945-bce4-e51065f378ff service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:17.013409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a0a9-d9b8-4945-bce4-e51065f378ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:17.013409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a0a9-d9b8-4945-bce4-e51065f378ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:17.021397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548a0a9-d9b8-4945-bce4-e51065f378ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:17.022817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548a0a9-d9b8-4945-bce4-e51065f378ff service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:17.032130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 737/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:16:19.230048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5693c-9d53-4018-b3cc-4d448862f8a1 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:19.230576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5693c-9d53-4018-b3cc-4d448862f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:19.230576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5693c-9d53-4018-b3cc-4d448862f8a1 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:19.231966 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:19.237673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f82f5-3d5a-4f4c-b957-cbad53d582f4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:19.238121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f82f5-3d5a-4f4c-b957-cbad53d582f4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:19.238236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f82f5-3d5a-4f4c-b957-cbad53d582f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:19.256110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c27f82f5-3d5a-4f4c-b957-cbad53d582f4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:19.257326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c27f82f5-3d5a-4f4c-b957-cbad53d582f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:19.265270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:19.301075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5693c-9d53-4018-b3cc-4d448862f8a1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:19.311564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5693c-9d53-4018-b3cc-4d448862f8a1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:19.315712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e90f6-fe3d-49ce-a8cc-eed1075a096e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:19.316367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e90f6-fe3d-49ce-a8cc-eed1075a096e service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:19.316654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e90f6-fe3d-49ce-a8cc-eed1075a096e service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:19.316931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e90f6-fe3d-49ce-a8cc-eed1075a096e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:19.325807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e90f6-fe3d-49ce-a8cc-eed1075a096e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:19.327246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e90f6-fe3d-49ce-a8cc-eed1075a096e service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:19.336485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 732/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:29.250577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=11 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:16:29.332257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=14 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:16:52.130254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bf5f8-69e6-4a89-a801-d46360606af8 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:52.130874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bf5f8-69e6-4a89-a801-d46360606af8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:52.131075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bf5f8-69e6-4a89-a801-d46360606af8 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:52.132502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 739/1471] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:52.137768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f984-89ed-4660-a1ba-399e141ae26d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:52.138185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f984-89ed-4660-a1ba-399e141ae26d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:52.138328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f984-89ed-4660-a1ba-399e141ae26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:52.155669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bd37f984-89ed-4660-a1ba-399e141ae26d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:52.156915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bd37f984-89ed-4660-a1ba-399e141ae26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:52.164548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 733/1472] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:52.211706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d973b95-b86a-4a4b-ba81-71a5e8f86aad None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:52.212000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d973b95-b86a-4a4b-ba81-71a5e8f86aad None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:52.212281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d973b95-b86a-4a4b-ba81-71a5e8f86aad None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:52.213669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 740/1473] 10.222.0.15 () {54 vars in 962 bytes} [Thu May 26 03:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:52.218436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adede702-7245-497d-8712-a566ec605b36 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:52.218726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adede702-7245-497d-8712-a566ec605b36 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:52.219001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adede702-7245-497d-8712-a566ec605b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:52.236980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-adede702-7245-497d-8712-a566ec605b36 None None] MFA Rules not processed for user `99b95fdb06a94c1586148df32413085f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:52.238156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-adede702-7245-497d-8712-a566ec605b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:52.244455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 734/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Thu May 26 03:16:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:52.251905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d973b95-b86a-4a4b-ba81-71a5e8f86aad None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:52.262273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d973b95-b86a-4a4b-ba81-71a5e8f86aad None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:52.265753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a41ea4-47ec-4915-939b-182d19f2546b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b95fdb06a94c1586148df32413085f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:52.266354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41ea4-47ec-4915-939b-182d19f2546b service glance] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:52.266641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41ea4-47ec-4915-939b-182d19f2546b service glance] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:52.266921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41ea4-47ec-4915-939b-182d19f2546b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:52.275638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a41ea4-47ec-4915-939b-182d19f2546b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:52.277090 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a41ea4-47ec-4915-939b-182d19f2546b service glance] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:52.286327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 741/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:16:54.533883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df017f-9761-4fb8-b98a-c293c70a3d86 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:54.534431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df017f-9761-4fb8-b98a-c293c70a3d86 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:54.534431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df017f-9761-4fb8-b98a-c293c70a3d86 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:54.535806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 735/1476] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:54.541050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c9a8-3b53-4844-b08b-1fec0a1b7e5e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:54.541485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c9a8-3b53-4844-b08b-1fec0a1b7e5e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:54.541601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c9a8-3b53-4844-b08b-1fec0a1b7e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:54.558757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-de37c9a8-3b53-4844-b08b-1fec0a1b7e5e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:54.559940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-de37c9a8-3b53-4844-b08b-1fec0a1b7e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:54.567609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 742/1477] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:54.590771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df017f-9761-4fb8-b98a-c293c70a3d86 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:54.603986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df017f-9761-4fb8-b98a-c293c70a3d86 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:54.608529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c64a3-9adb-44ce-9df5-6da508c08196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:54.609165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c64a3-9adb-44ce-9df5-6da508c08196 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:54.609445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c64a3-9adb-44ce-9df5-6da508c08196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:54.609717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c64a3-9adb-44ce-9df5-6da508c08196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:54.610445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c64a3-9adb-44ce-9df5-6da508c08196 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:54.612202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-a74c64a3-9adb-44ce-9df5-6da508c08196 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:16:54.612202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: warnings.warn(msg) May 26 03:16:54.612202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: May 26 03:16:54.613362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c64a3-9adb-44ce-9df5-6da508c08196 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:54.632211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 736/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Thu May 26 03:16:54 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:16:56.807384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e0658-063e-41b3-8544-eeae0e1407d2 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:56.807808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e0658-063e-41b3-8544-eeae0e1407d2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:56.807942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e0658-063e-41b3-8544-eeae0e1407d2 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:56.809353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 743/1479] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:56.814632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0798d-69d6-44ee-80bc-4b91b12db587 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:56.815074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0798d-69d6-44ee-80bc-4b91b12db587 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:56.815180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0798d-69d6-44ee-80bc-4b91b12db587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:56.833711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-21e0798d-69d6-44ee-80bc-4b91b12db587 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:56.834946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-21e0798d-69d6-44ee-80bc-4b91b12db587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:56.842758 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 737/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:16:56.885749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e0658-063e-41b3-8544-eeae0e1407d2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:56.900149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e0658-063e-41b3-8544-eeae0e1407d2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:56.905656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e450ac-8cf5-4806-9eee-b0552741a08b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:56.906300 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e450ac-8cf5-4806-9eee-b0552741a08b service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:56.906583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e450ac-8cf5-4806-9eee-b0552741a08b service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:56.906861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e450ac-8cf5-4806-9eee-b0552741a08b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:56.915019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e450ac-8cf5-4806-9eee-b0552741a08b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:56.916638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e450ac-8cf5-4806-9eee-b0552741a08b service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:56.925857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 744/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:16:59.277394 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceadb8e-5bbf-486a-9e46-ed56e2d46a17 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:59.277919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceadb8e-5bbf-486a-9e46-ed56e2d46a17 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:59.278046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceadb8e-5bbf-486a-9e46-ed56e2d46a17 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:59.279378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 738/1482] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:16:59.284863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487a4d-7f4f-4e8e-91f3-16d2c69421fe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:59.285269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487a4d-7f4f-4e8e-91f3-16d2c69421fe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:59.285417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487a4d-7f4f-4e8e-91f3-16d2c69421fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:59.306430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6f487a4d-7f4f-4e8e-91f3-16d2c69421fe None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:16:59.307611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6f487a4d-7f4f-4e8e-91f3-16d2c69421fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:16:59.315857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 745/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:16:59.351081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceadb8e-5bbf-486a-9e46-ed56e2d46a17 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:16:59.361545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceadb8e-5bbf-486a-9e46-ed56e2d46a17 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:16:59.365038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a81091-5c0f-49f2-833c-a353936c6c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:16:59.365668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81091-5c0f-49f2-833c-a353936c6c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:16:59.365951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81091-5c0f-49f2-833c-a353936c6c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:16:59.366227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81091-5c0f-49f2-833c-a353936c6c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:16:59.375729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a81091-5c0f-49f2-833c-a353936c6c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:16:59.377214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a81091-5c0f-49f2-833c-a353936c6c59 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:16:59.386451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 739/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:17:01.622729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbbe28-318f-431d-b64b-c57244bbb908 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:17:01.623209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbbe28-318f-431d-b64b-c57244bbb908 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:17:01.623312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbbe28-318f-431d-b64b-c57244bbb908 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:17:01.624673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 746/1485] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:17:01.630094 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1ed84-0a5d-45bb-a71f-ae0ae930ed1a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:17:01.630529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1ed84-0a5d-45bb-a71f-ae0ae930ed1a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:17:01.630680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1ed84-0a5d-45bb-a71f-ae0ae930ed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:17:01.647935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b8a1ed84-0a5d-45bb-a71f-ae0ae930ed1a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:17:01.649167 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b8a1ed84-0a5d-45bb-a71f-ae0ae930ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:17:01.657557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 740/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:17:01.694632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbbe28-318f-431d-b64b-c57244bbb908 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:17:01.705915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbbe28-318f-431d-b64b-c57244bbb908 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:17:01.709342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6e29d-9f30-47e1-b71a-83682012b814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:17:01.709970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6e29d-9f30-47e1-b71a-83682012b814 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:17:01.710251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6e29d-9f30-47e1-b71a-83682012b814 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:17:01.710527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6e29d-9f30-47e1-b71a-83682012b814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:17:01.719714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6e29d-9f30-47e1-b71a-83682012b814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:17:01.721159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6e29d-9f30-47e1-b71a-83682012b814 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:17:01.730209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 747/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:17:04.132223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05479-dfd1-4ed5-bf97-b0d3029a2f96 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:17:04.132775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05479-dfd1-4ed5-bf97-b0d3029a2f96 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:17:04.132883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05479-dfd1-4ed5-bf97-b0d3029a2f96 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:17:04.134200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 741/1488] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:17:04.139486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046175b-f942-4622-ba69-a298d68124e8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:17:04.139892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046175b-f942-4622-ba69-a298d68124e8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:17:04.140038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046175b-f942-4622-ba69-a298d68124e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:17:04.157220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3046175b-f942-4622-ba69-a298d68124e8 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:17:04.158418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3046175b-f942-4622-ba69-a298d68124e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:17:04.165927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 748/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:17:04.205807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05479-dfd1-4ed5-bf97-b0d3029a2f96 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:17:04.216380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05479-dfd1-4ed5-bf97-b0d3029a2f96 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:17:04.219858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aaa26-4bce-460c-82e3-5d975f09926c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:17:04.220529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aaa26-4bce-460c-82e3-5d975f09926c service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:17:04.220817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aaa26-4bce-460c-82e3-5d975f09926c service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:17:04.221097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aaa26-4bce-460c-82e3-5d975f09926c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:17:04.229816 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aaa26-4bce-460c-82e3-5d975f09926c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:17:04.231255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aaa26-4bce-460c-82e3-5d975f09926c service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:17:04.241105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 742/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:17:06.838854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443001f-5b81-42f9-9c14-a639b3f36377 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:17:06.839393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443001f-5b81-42f9-9c14-a639b3f36377 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:17:06.839393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443001f-5b81-42f9-9c14-a639b3f36377 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:17:06.840837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 749/1491] 10.222.0.15 () {54 vars in 926 bytes} [Thu May 26 03:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:17:06.846042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244f35-a9c6-47b7-92c8-92d12f26a2b1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:17:06.846445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244f35-a9c6-47b7-92c8-92d12f26a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:17:06.846596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244f35-a9c6-47b7-92c8-92d12f26a2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:17:06.863689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-23244f35-a9c6-47b7-92c8-92d12f26a2b1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:17:06.864893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-23244f35-a9c6-47b7-92c8-92d12f26a2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:17:06.872391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 743/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Thu May 26 03:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:17:06.910493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443001f-5b81-42f9-9c14-a639b3f36377 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:17:06.921192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443001f-5b81-42f9-9c14-a639b3f36377 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:17:06.924722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ffcfb-4d01-4543-a586-6fff05b5a4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:17:06.925356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ffcfb-4d01-4543-a586-6fff05b5a4fa service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:17:06.925643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ffcfb-4d01-4543-a586-6fff05b5a4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:17:06.925937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ffcfb-4d01-4543-a586-6fff05b5a4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:17:06.934713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ffcfb-4d01-4543-a586-6fff05b5a4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:17:06.938268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ffcfb-4d01-4543-a586-6fff05b5a4fa service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:17:06.946091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 750/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:17:16.859274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=33 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:17:16.941834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=33 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:18:53.323639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406d578-d7b4-41bf-ba82-2102f3707dfd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.324213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406d578-d7b4-41bf-ba82-2102f3707dfd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.324213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406d578-d7b4-41bf-ba82-2102f3707dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.341745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6406d578-d7b4-41bf-ba82-2102f3707dfd None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:18:53.342925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6406d578-d7b4-41bf-ba82-2102f3707dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:18:53.350631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 744/1494] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:18:53.360064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df2816-c201-46bb-83be-909e154376e6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.360594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df2816-c201-46bb-83be-909e154376e6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.360692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df2816-c201-46bb-83be-909e154376e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.378641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f7df2816-c201-46bb-83be-909e154376e6 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:18:53.379808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f7df2816-c201-46bb-83be-909e154376e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:18:53.387411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 751/1495] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:18:53.391769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406d578-d7b4-41bf-ba82-2102f3707dfd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:53.401154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406d578-d7b4-41bf-ba82-2102f3707dfd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:53.405705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:53.406347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.406632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.406909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.407622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:18:53.407928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:53.408976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 03:18:53.408976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: warnings.warn(msg) May 26 03:18:53.408976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: May 26 03:18:53.409863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:53.421704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 745/1496] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:18:53.429388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df2816-c201-46bb-83be-909e154376e6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:53.439328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df2816-c201-46bb-83be-909e154376e6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:53.443948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acb007-45b4-4877-80ae-9b9586185f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:53.444646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acb007-45b4-4877-80ae-9b9586185f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.445287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acb007-45b4-4877-80ae-9b9586185f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.445564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acb007-45b4-4877-80ae-9b9586185f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.446257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acb007-45b4-4877-80ae-9b9586185f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:53.448006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-78acb007-45b4-4877-80ae-9b9586185f93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:18:53.448006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: warnings.warn(msg) May 26 03:18:53.448006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: May 26 03:18:53.449228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acb007-45b4-4877-80ae-9b9586185f93 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:53.542011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 752/1497] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:18:53 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:18:53.546737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:53.556574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bebde-2c85-4221-bdfb-194d921609e5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:53.612829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d65f5-dfdb-4888-9656-3f38dfa61909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:53.613417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d65f5-dfdb-4888-9656-3f38dfa61909 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.613698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d65f5-dfdb-4888-9656-3f38dfa61909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.614217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d65f5-dfdb-4888-9656-3f38dfa61909 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.614904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d65f5-dfdb-4888-9656-3f38dfa61909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:53.615915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-bf6d65f5-dfdb-4888-9656-3f38dfa61909 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:18:53.615915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: warnings.warn(msg) May 26 03:18:53.615915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: May 26 03:18:53.617146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d65f5-dfdb-4888-9656-3f38dfa61909 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:53.683387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 746/1498] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:18:53 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:18:53.687476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acb007-45b4-4877-80ae-9b9586185f93 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:53.698318 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acb007-45b4-4877-80ae-9b9586185f93 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:53.702816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b47ac-434d-4dd1-9b2f-4ed9d516a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:53.703467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b47ac-434d-4dd1-9b2f-4ed9d516a1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.703769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b47ac-434d-4dd1-9b2f-4ed9d516a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.704043 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b47ac-434d-4dd1-9b2f-4ed9d516a1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.704791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b47ac-434d-4dd1-9b2f-4ed9d516a1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:53.705788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-954b47ac-434d-4dd1-9b2f-4ed9d516a1bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 03:18:53.705788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: warnings.warn(msg) May 26 03:18:53.705788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: May 26 03:18:53.706673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b47ac-434d-4dd1-9b2f-4ed9d516a1bd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:53.719640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 753/1499] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:18:53.723879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d65f5-dfdb-4888-9656-3f38dfa61909 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:53.734372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d65f5-dfdb-4888-9656-3f38dfa61909 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:53.738875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abfdad-521e-470b-bbb3-a3a771ad1c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:53.739557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abfdad-521e-470b-bbb3-a3a771ad1c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.739846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abfdad-521e-470b-bbb3-a3a771ad1c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.740111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abfdad-521e-470b-bbb3-a3a771ad1c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.740868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abfdad-521e-470b-bbb3-a3a771ad1c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:53.741863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-78abfdad-521e-470b-bbb3-a3a771ad1c7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 03:18:53.741863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: warnings.warn(msg) May 26 03:18:53.741863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: May 26 03:18:53.742746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abfdad-521e-470b-bbb3-a3a771ad1c7a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:53.761058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 747/1500] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:18:53.765284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b47ac-434d-4dd1-9b2f-4ed9d516a1bd admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:53.775356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b47ac-434d-4dd1-9b2f-4ed9d516a1bd admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:53.780492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0ed7d-08ec-4f7e-af08-f92c59781442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:53.781366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0ed7d-08ec-4f7e-af08-f92c59781442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.781655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0ed7d-08ec-4f7e-af08-f92c59781442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.781934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0ed7d-08ec-4f7e-af08-f92c59781442 admin admin] PATH_INFO: `/v3/projects/c76048e73843490fb3efe9047fd3ab56/users/35a0eb2b5eea422d86b2155bbc047700/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.797671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0ed7d-08ec-4f7e-af08-f92c59781442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76048e73843490fb3efe9047fd3ab56, user_id=35a0eb2b5eea422d86b2155bbc047700, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:53.798683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-d2b0ed7d-08ec-4f7e-af08-f92c59781442 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:18:53.798683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: warnings.warn(msg) May 26 03:18:53.798683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: May 26 03:18:53.800636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0ed7d-08ec-4f7e-af08-f92c59781442 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:53.854325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 754/1501] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:18:53 2022] PUT /identity/v3/projects/c76048e73843490fb3efe9047fd3ab56/users/35a0eb2b5eea422d86b2155bbc047700/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:18:53.875899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586fdd-f745-4e4b-9c2b-7b3c0ab3c01a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.876237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586fdd-f745-4e4b-9c2b-7b3c0ab3c01a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.876544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586fdd-f745-4e4b-9c2b-7b3c0ab3c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.902264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f8586fdd-f745-4e4b-9c2b-7b3c0ab3c01a None None] MFA Rules not processed for user `35a0eb2b5eea422d86b2155bbc047700`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:18:53.903442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f8586fdd-f745-4e4b-9c2b-7b3c0ab3c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:18:53.964264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 748/1502] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:18:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:18:53.977892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4d71-a5fc-4dce-ae15-b7895b395fb2 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.978182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4d71-a5fc-4dce-ae15-b7895b395fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.978460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4d71-a5fc-4dce-ae15-b7895b395fb2 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:53.979806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 755/1503] 10.222.0.15 () {54 vars in 963 bytes} [Thu May 26 03:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:18:53.984523 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa002e4-770d-49d9-999b-5662de274d29 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:53.984814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa002e4-770d-49d9-999b-5662de274d29 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:53.985090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa002e4-770d-49d9-999b-5662de274d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:54.002244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1aa002e4-770d-49d9-999b-5662de274d29 None None] MFA Rules not processed for user `e479d9969f534788b2f35685e4e28da8`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:18:54.003404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1aa002e4-770d-49d9-999b-5662de274d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:18:54.046005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:18:54.053054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 749/1504] 10.222.0.15 () {58 vars in 1060 bytes} [Thu May 26 03:18:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:18:54.164372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc4d71-a5fc-4dce-ae15-b7895b395fb2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:54.174789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc4d71-a5fc-4dce-ae15-b7895b395fb2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:54.178294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c150c8-18fc-463b-b1bf-8c5995eb24f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:54.178918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c150c8-18fc-463b-b1bf-8c5995eb24f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:54.179199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c150c8-18fc-463b-b1bf-8c5995eb24f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:54.179473 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c150c8-18fc-463b-b1bf-8c5995eb24f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:54.187942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c150c8-18fc-463b-b1bf-8c5995eb24f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:54.189384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c150c8-18fc-463b-b1bf-8c5995eb24f5 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:54.198273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 756/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:18:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:18:54.240981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794770bc-507b-4d70-9cbc-c04ffa719b25 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:54.241274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794770bc-507b-4d70-9cbc-c04ffa719b25 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:54.241554 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794770bc-507b-4d70-9cbc-c04ffa719b25 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:54.242842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 750/1506] 10.222.0.15 () {52 vars in 829 bytes} [Thu May 26 03:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:18:54.246306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c150c8-18fc-463b-b1bf-8c5995eb24f5 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:54.307722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c150c8-18fc-463b-b1bf-8c5995eb24f5 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:54.312715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:54.313565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:54.313839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:54.314109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] PATH_INFO: `/v3/users/35a0eb2b5eea422d86b2155bbc047700` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:54.315344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a0eb2b5eea422d86b2155bbc047700)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:54.316387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:18:54.316387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: warnings.warn(msg) May 26 03:18:54.316387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: May 26 03:18:54.317670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:54.540251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a0eb2b5eea422d86b2155bbc047700'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:54.540901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a0eb2b5eea422d86b2155bbc047700'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:54.553490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a0eb2b5eea422d86b2155bbc047700'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:54.554230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a0eb2b5eea422d86b2155bbc047700'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:54.572637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a0eb2b5eea422d86b2155bbc047700'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:54.579574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:18:54.672013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 757/1507] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:18:54 2022] DELETE /identity/v3/users/35a0eb2b5eea422d86b2155bbc047700 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:18:54.676427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17131-1856-4593-ae47-95d9fa15fe9d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:54.676900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17131-1856-4593-ae47-95d9fa15fe9d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:54.676997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17131-1856-4593-ae47-95d9fa15fe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:54.694452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ddd17131-1856-4593-ae47-95d9fa15fe9d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:18:54.695940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ddd17131-1856-4593-ae47-95d9fa15fe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:18:54.753142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 751/1508] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:18:54.762640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:54.764084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:18:54.820728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8b939-0462-48a9-8555-f0e054b3ae1e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:54.824300 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076383f-d7ea-475f-8f2b-51da479bf808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:54.824971 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076383f-d7ea-475f-8f2b-51da479bf808 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:54.825256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076383f-d7ea-475f-8f2b-51da479bf808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:54.825534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076383f-d7ea-475f-8f2b-51da479bf808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:54.834245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076383f-d7ea-475f-8f2b-51da479bf808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:54.835666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076383f-d7ea-475f-8f2b-51da479bf808 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:54.844882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 758/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:18:55.319447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17131-1856-4593-ae47-95d9fa15fe9d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:18:55.321196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ddd17131-1856-4593-ae47-95d9fa15fe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:18:55.333854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17131-1856-4593-ae47-95d9fa15fe9d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:18:55.338731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:18:55.342081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:18:55.342081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:18:55.342081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] PATH_INFO: `/v3/projects/c76048e73843490fb3efe9047fd3ab56` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:18:55.342081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76048e73843490fb3efe9047fd3ab56)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:18:55.343121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:18:55.343121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: warnings.warn(msg) May 26 03:18:55.343121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: May 26 03:18:55.344452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:18:55.481684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76048e73843490fb3efe9047fd3ab56', 'request_id': 'req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:55.545230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76048e73843490fb3efe9047fd3ab56', 'request_id': 'req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:55.558682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76048e73843490fb3efe9047fd3ab56', 'request_id': 'req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:55.569360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] The token cache is being invalidate because project c76048e73843490fb3efe9047fd3ab56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:18:55.569651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:55.570647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b7b10abb-5c4b-4e53-bd48-3e4e928507f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:18:55.572187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 752/1510] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:18:55 2022] DELETE /identity/v3/projects/c76048e73843490fb3efe9047fd3ab56 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:19:04.840731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:19:05.566337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:20:39.653870 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb64c7d-b87f-4b62-b23f-3cede676a18b None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:39.654576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb64c7d-b87f-4b62-b23f-3cede676a18b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:39.654576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb64c7d-b87f-4b62-b23f-3cede676a18b None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:39.655821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 03:20:39.660647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf402e-46b6-4d6b-8998-e0016fa0e0c0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:39.661086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf402e-46b6-4d6b-8998-e0016fa0e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:39.661197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf402e-46b6-4d6b-8998-e0016fa0e0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:39.679161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-13bf402e-46b6-4d6b-8998-e0016fa0e0c0 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:20:39.680418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13bf402e-46b6-4d6b-8998-e0016fa0e0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:20:39.740617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:20:39.909556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb64c7d-b87f-4b62-b23f-3cede676a18b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:20:39.911321 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3cb64c7d-b87f-4b62-b23f-3cede676a18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:20:39.986038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb64c7d-b87f-4b62-b23f-3cede676a18b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:20:39.991577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa6e5-84c9-478c-a52d-899169b7c7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:20:39.992220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa6e5-84c9-478c-a52d-899169b7c7ed service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:39.992542 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa6e5-84c9-478c-a52d-899169b7c7ed service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:39.992822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa6e5-84c9-478c-a52d-899169b7c7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:40.001501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faa6e5-84c9-478c-a52d-899169b7c7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:20:40.003115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faa6e5-84c9-478c-a52d-899169b7c7ed service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:20:40.013202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 760/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:20:40.877951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac2516-87cd-45f1-a54f-d20aa8fcb44c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:40.878478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac2516-87cd-45f1-a54f-d20aa8fcb44c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:40.878587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac2516-87cd-45f1-a54f-d20aa8fcb44c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:40.879913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:20:40.884849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33dfd6-7350-4515-8db4-9db82a2ca2db None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:40.885268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33dfd6-7350-4515-8db4-9db82a2ca2db None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:40.885405 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33dfd6-7350-4515-8db4-9db82a2ca2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:40.903640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2d33dfd6-7350-4515-8db4-9db82a2ca2db None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:20:40.904873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2d33dfd6-7350-4515-8db4-9db82a2ca2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:20:40.912619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:20:41.062558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac2516-87cd-45f1-a54f-d20aa8fcb44c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:20:41.077507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac2516-87cd-45f1-a54f-d20aa8fcb44c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:20:41.082792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8578d-26a5-4c2b-8dcb-8eacd89daeae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:20:41.083429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8578d-26a5-4c2b-8dcb-8eacd89daeae service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:41.083712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8578d-26a5-4c2b-8dcb-8eacd89daeae service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:41.083986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8578d-26a5-4c2b-8dcb-8eacd89daeae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:41.092495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8578d-26a5-4c2b-8dcb-8eacd89daeae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:20:41.094098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8578d-26a5-4c2b-8dcb-8eacd89daeae service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:20:41.103175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 755/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:20:41.794418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa8fee-b52e-4d56-a09c-7618d55e71ea None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:41.794706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa8fee-b52e-4d56-a09c-7618d55e71ea None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:41.794986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa8fee-b52e-4d56-a09c-7618d55e71ea None None] PATH_INFO: `/v3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:41.796326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 762/1517] 10.222.0.21 () {54 vars in 925 bytes} [Thu May 26 03:20:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:20:41.802330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13eb9-97c1-4f98-b149-c80e0df9e711 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:41.802626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13eb9-97c1-4f98-b149-c80e0df9e711 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:41.802910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13eb9-97c1-4f98-b149-c80e0df9e711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:41.823570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-20c13eb9-97c1-4f98-b149-c80e0df9e711 None None] MFA Rules not processed for user `257d9a088fa04cd5af48d6e4fb8b2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:20:41.824855 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-20c13eb9-97c1-4f98-b149-c80e0df9e711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:20:41.885310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 756/1518] 10.222.0.21 () {58 vars in 1015 bytes} [Thu May 26 03:20:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:20:46.100852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063efd0-fd8d-40bd-a9a3-922bb2c848c2 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:46.101438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063efd0-fd8d-40bd-a9a3-922bb2c848c2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:46.101438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063efd0-fd8d-40bd-a9a3-922bb2c848c2 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:46.102774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 763/1519] 10.222.0.15 () {54 vars in 960 bytes} [Thu May 26 03:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:20:46.107741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b651a-e91e-46d4-9f4c-ee54024569f6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:46.108531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b651a-e91e-46d4-9f4c-ee54024569f6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:46.108811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b651a-e91e-46d4-9f4c-ee54024569f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:46.127011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-794b651a-e91e-46d4-9f4c-ee54024569f6 None None] MFA Rules not processed for user `257d9a088fa04cd5af48d6e4fb8b2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:20:46.128183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-794b651a-e91e-46d4-9f4c-ee54024569f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:20:46.137066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 757/1520] 10.222.0.15 () {58 vars in 1057 bytes} [Thu May 26 03:20:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:20:46.144393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063efd0-fd8d-40bd-a9a3-922bb2c848c2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:20:46.157334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063efd0-fd8d-40bd-a9a3-922bb2c848c2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:20:46.162152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e632a-408a-41c2-8c84-8c3df40a7f1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:20:46.162804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e632a-408a-41c2-8c84-8c3df40a7f1a service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:46.163086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e632a-408a-41c2-8c84-8c3df40a7f1a service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:46.163360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e632a-408a-41c2-8c84-8c3df40a7f1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:46.171387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e632a-408a-41c2-8c84-8c3df40a7f1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:20:46.172998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e632a-408a-41c2-8c84-8c3df40a7f1a service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:20:46.182822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 764/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:20:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:20:52.386164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb5c4-b043-47fe-a049-c48519db630a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:52.386763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb5c4-b043-47fe-a049-c48519db630a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:52.386763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb5c4-b043-47fe-a049-c48519db630a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:52.388134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:20:52.392843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562753c-ead8-4c25-ae4e-29bdddccc141 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:52.393227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562753c-ead8-4c25-ae4e-29bdddccc141 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:52.393401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562753c-ead8-4c25-ae4e-29bdddccc141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:52.411662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d562753c-ead8-4c25-ae4e-29bdddccc141 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:20:52.412868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d562753c-ead8-4c25-ae4e-29bdddccc141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:20:52.420654 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:20:52.572788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb5c4-b043-47fe-a049-c48519db630a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:20:52.586888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb5c4-b043-47fe-a049-c48519db630a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:20:52.593063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77326961-da94-4af7-aaeb-0c6af5f764b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:20:52.595901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77326961-da94-4af7-aaeb-0c6af5f764b2 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:52.595901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77326961-da94-4af7-aaeb-0c6af5f764b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:52.595901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77326961-da94-4af7-aaeb-0c6af5f764b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:52.602535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77326961-da94-4af7-aaeb-0c6af5f764b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:20:52.604124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77326961-da94-4af7-aaeb-0c6af5f764b2 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:20:52.613391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 759/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:20:53.470062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1db5c-5fc2-47b3-82eb-4827053b6bdb None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:53.470626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1db5c-5fc2-47b3-82eb-4827053b6bdb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:53.470626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1db5c-5fc2-47b3-82eb-4827053b6bdb None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:53.472035 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 03:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:20:53.476902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799535c1-3d7d-4ba3-bbca-dd8db18374c5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:53.477293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799535c1-3d7d-4ba3-bbca-dd8db18374c5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:53.477465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799535c1-3d7d-4ba3-bbca-dd8db18374c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:53.495441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-799535c1-3d7d-4ba3-bbca-dd8db18374c5 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:20:53.496659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-799535c1-3d7d-4ba3-bbca-dd8db18374c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:20:53.504413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 03:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:20:53.656707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1db5c-5fc2-47b3-82eb-4827053b6bdb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:20:53.671411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1db5c-5fc2-47b3-82eb-4827053b6bdb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:20:53.676691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52880f0b-b7fc-4f3b-9fd2-d1b9b82de6a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:20:53.677321 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52880f0b-b7fc-4f3b-9fd2-d1b9b82de6a6 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:53.677602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52880f0b-b7fc-4f3b-9fd2-d1b9b82de6a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:53.677878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52880f0b-b7fc-4f3b-9fd2-d1b9b82de6a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:53.685893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52880f0b-b7fc-4f3b-9fd2-d1b9b82de6a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:20:53.687454 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52880f0b-b7fc-4f3b-9fd2-d1b9b82de6a6 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:20:53.697369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 767/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:20:57.629551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f993b-9995-41a7-8948-e85852f697a1 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:57.630139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f993b-9995-41a7-8948-e85852f697a1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:57.630139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f993b-9995-41a7-8948-e85852f697a1 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:57.631464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:20:57.636673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1775-516e-4da6-896a-45be4d1bf058 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:57.637068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1775-516e-4da6-896a-45be4d1bf058 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:57.637237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1775-516e-4da6-896a-45be4d1bf058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:57.656830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7c3b1775-516e-4da6-896a-45be4d1bf058 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:20:57.658021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7c3b1775-516e-4da6-896a-45be4d1bf058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:20:57.666294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:20:57.703671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f993b-9995-41a7-8948-e85852f697a1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:20:57.705691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-728f993b-9995-41a7-8948-e85852f697a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:20:57.762350 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f993b-9995-41a7-8948-e85852f697a1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:20:57.765844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563f833-0a4e-4fcc-b86c-31e9a008c1fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:20:57.766479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563f833-0a4e-4fcc-b86c-31e9a008c1fb service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:57.766757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563f833-0a4e-4fcc-b86c-31e9a008c1fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:57.767028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563f833-0a4e-4fcc-b86c-31e9a008c1fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:57.775832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563f833-0a4e-4fcc-b86c-31e9a008c1fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:20:57.777288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563f833-0a4e-4fcc-b86c-31e9a008c1fb service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:20:57.782086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:20:57.786848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 762/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:20:59.973369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31240d1-e800-45fd-955c-a6c519362bab None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:59.973933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31240d1-e800-45fd-955c-a6c519362bab None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:59.973933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31240d1-e800-45fd-955c-a6c519362bab None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:59.975316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:20:59.980736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e32eb-2904-4f8f-8975-45173a432647 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:20:59.981141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e32eb-2904-4f8f-8975-45173a432647 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:20:59.981266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e32eb-2904-4f8f-8975-45173a432647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:20:59.998817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e79e32eb-2904-4f8f-8975-45173a432647 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:20:59.999995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e79e32eb-2904-4f8f-8975-45173a432647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:21:00.007618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:21:00.043621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31240d1-e800-45fd-955c-a6c519362bab None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:21:00.054355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31240d1-e800-45fd-955c-a6c519362bab None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:21:00.057869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa668b2-bcba-4d42-abb8-38476ac9fdca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:21:00.058502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa668b2-bcba-4d42-abb8-38476ac9fdca service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:21:00.058787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa668b2-bcba-4d42-abb8-38476ac9fdca service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:21:00.059064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa668b2-bcba-4d42-abb8-38476ac9fdca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:21:00.068126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa668b2-bcba-4d42-abb8-38476ac9fdca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:21:00.069576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa668b2-bcba-4d42-abb8-38476ac9fdca service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:21:00.079348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 770/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:21:03.677831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfed1-ce45-4c2d-a7c6-2b527e1d2019 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:21:03.678427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfed1-ce45-4c2d-a7c6-2b527e1d2019 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:21:03.678427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfed1-ce45-4c2d-a7c6-2b527e1d2019 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:21:03.679802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:21:03.685811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c931-d139-4cba-b52b-17c1b1bef71f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:21:03.686231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c931-d139-4cba-b52b-17c1b1bef71f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:21:03.686361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c931-d139-4cba-b52b-17c1b1bef71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:21:03.834932 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-af56c931-d139-4cba-b52b-17c1b1bef71f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:21:03.836210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-af56c931-d139-4cba-b52b-17c1b1bef71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:21:03.844023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:21:04.113657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabfed1-ce45-4c2d-a7c6-2b527e1d2019 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:21:04.115342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ebabfed1-ce45-4c2d-a7c6-2b527e1d2019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:21:04.170935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabfed1-ce45-4c2d-a7c6-2b527e1d2019 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:21:04.174475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304a5c7-a0ae-4abf-aa58-fd5ddd8ed279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:21:04.175110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a5c7-a0ae-4abf-aa58-fd5ddd8ed279 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:21:04.175391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a5c7-a0ae-4abf-aa58-fd5ddd8ed279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:21:04.175665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a5c7-a0ae-4abf-aa58-fd5ddd8ed279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:21:04.184329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304a5c7-a0ae-4abf-aa58-fd5ddd8ed279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:21:04.185761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304a5c7-a0ae-4abf-aa58-fd5ddd8ed279 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:21:04.195288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 765/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:21:06.388591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00b893-3aed-49a3-bc79-e942fbfe6b96 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:21:06.389156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00b893-3aed-49a3-bc79-e942fbfe6b96 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:21:06.389156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00b893-3aed-49a3-bc79-e942fbfe6b96 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:21:06.390506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 03:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:21:06.395805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e207b40-9e05-4d48-a8da-0f0bf66078cb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:21:06.396195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e207b40-9e05-4d48-a8da-0f0bf66078cb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:21:06.396396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e207b40-9e05-4d48-a8da-0f0bf66078cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:21:06.414033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6e207b40-9e05-4d48-a8da-0f0bf66078cb None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:21:06.415248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6e207b40-9e05-4d48-a8da-0f0bf66078cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:21:06.422903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 03:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:21:06.690648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00b893-3aed-49a3-bc79-e942fbfe6b96 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:21:06.692282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2b00b893-3aed-49a3-bc79-e942fbfe6b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:21:06.699718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=65 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:21:06.705624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00b893-3aed-49a3-bc79-e942fbfe6b96 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:21:06.709228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8b06-c84a-4b07-85b4-7d33269ff920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:21:06.709893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8b06-c84a-4b07-85b4-7d33269ff920 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:21:06.710178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8b06-c84a-4b07-85b4-7d33269ff920 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:21:06.710457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8b06-c84a-4b07-85b4-7d33269ff920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:21:06.719382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8b06-c84a-4b07-85b4-7d33269ff920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:21:06.720838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8b06-c84a-4b07-85b4-7d33269ff920 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:21:06.730822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 773/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:21:16.408882 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=32 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:21:16.740557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:46.580162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc9f4-5e66-49c2-850e-368ed0893a5b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.580842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc9f4-5e66-49c2-850e-368ed0893a5b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.580842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc9f4-5e66-49c2-850e-368ed0893a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.606723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f173b-3091-4b02-8b1e-f67813e3dd5b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.607324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f173b-3091-4b02-8b1e-f67813e3dd5b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.607525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f173b-3091-4b02-8b1e-f67813e3dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.607700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-878dc9f4-5e66-49c2-850e-368ed0893a5b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.609254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-878dc9f4-5e66-49c2-850e-368ed0893a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.625015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 767/1540] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.626341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b75851-ea9d-4392-afc5-319283e4cf78 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.626631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b75851-ea9d-4392-afc5-319283e4cf78 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.626908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b75851-ea9d-4392-afc5-319283e4cf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.631977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-879f173b-3091-4b02-8b1e-f67813e3dd5b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.633634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-879f173b-3091-4b02-8b1e-f67813e3dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.643517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 774/1541] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:22:46.644852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe121abe-28ca-4d70-997f-8d26c14c9d05 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.645141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe121abe-28ca-4d70-997f-8d26c14c9d05 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.645419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe121abe-28ca-4d70-997f-8d26c14c9d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.661341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a7b75851-ea9d-4392-afc5-319283e4cf78 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.662549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a7b75851-ea9d-4392-afc5-319283e4cf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.674164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-fe121abe-28ca-4d70-997f-8d26c14c9d05 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.675480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fe121abe-28ca-4d70-997f-8d26c14c9d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.676069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 768/1542] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.677380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f0524-e07a-4a2f-9b98-b520f3d0003a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.677672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f0524-e07a-4a2f-9b98-b520f3d0003a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.677955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f0524-e07a-4a2f-9b98-b520f3d0003a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.684056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 775/1543] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.686900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac5b6b-b693-4b4d-9485-5b82981a27ec None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.687193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac5b6b-b693-4b4d-9485-5b82981a27ec None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.687586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac5b6b-b693-4b4d-9485-5b82981a27ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.703250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-556f0524-e07a-4a2f-9b98-b520f3d0003a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.704626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-556f0524-e07a-4a2f-9b98-b520f3d0003a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.706868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3aac5b6b-b693-4b4d-9485-5b82981a27ec None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.708053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3aac5b6b-b693-4b4d-9485-5b82981a27ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.713179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 769/1544] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.714184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de1709-279b-4b9d-be38-f186649e2b2b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.714474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de1709-279b-4b9d-be38-f186649e2b2b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.714754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de1709-279b-4b9d-be38-f186649e2b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.716635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 776/1545] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.717631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabba085-7aa6-4c8e-959d-a25d190e0cc3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.717969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabba085-7aa6-4c8e-959d-a25d190e0cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.718242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabba085-7aa6-4c8e-959d-a25d190e0cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.733860 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-77de1709-279b-4b9d-be38-f186649e2b2b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.735089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-77de1709-279b-4b9d-be38-f186649e2b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.735973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-fabba085-7aa6-4c8e-959d-a25d190e0cc3 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.737160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fabba085-7aa6-4c8e-959d-a25d190e0cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.742909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 770/1546] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.744115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880952-55e2-4690-b299-b3acd4679ca9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.744407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880952-55e2-4690-b299-b3acd4679ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.744684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880952-55e2-4690-b299-b3acd4679ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.747088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 777/1547] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.747088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5faa9-61dd-4f22-88d4-69afe9ad0b6e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.751775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5faa9-61dd-4f22-88d4-69afe9ad0b6e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.751775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5faa9-61dd-4f22-88d4-69afe9ad0b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.763940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-57880952-55e2-4690-b299-b3acd4679ca9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.765168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-57880952-55e2-4690-b299-b3acd4679ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.765298 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-70a5faa9-61dd-4f22-88d4-69afe9ad0b6e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.766359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-70a5faa9-61dd-4f22-88d4-69afe9ad0b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.772953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 771/1548] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.778074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 778/1549] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.778236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda28373-8b29-4dca-be8e-eeed34b423b0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.778236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda28373-8b29-4dca-be8e-eeed34b423b0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.778236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda28373-8b29-4dca-be8e-eeed34b423b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.778468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ea38-402c-4d8c-a37c-bd140e5a8d30 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.778468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ea38-402c-4d8c-a37c-bd140e5a8d30 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.778468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ea38-402c-4d8c-a37c-bd140e5a8d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.798966 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-56d9ea38-402c-4d8c-a37c-bd140e5a8d30 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.800192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-56d9ea38-402c-4d8c-a37c-bd140e5a8d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.808641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 779/1550] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.809517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9ea38-402c-4d8c-a37c-bd140e5a8d30 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:46.819930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9ea38-402c-4d8c-a37c-bd140e5a8d30 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:46.825001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25e572-8f01-42b5-9299-d8059e6cef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:46.825695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25e572-8f01-42b5-9299-d8059e6cef1e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.825978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25e572-8f01-42b5-9299-d8059e6cef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.826251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25e572-8f01-42b5-9299-d8059e6cef1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.826986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25e572-8f01-42b5-9299-d8059e6cef1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:46.827292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25e572-8f01-42b5-9299-d8059e6cef1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:46.828356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-1a25e572-8f01-42b5-9299-d8059e6cef1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 03:22:46.828356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: warnings.warn(msg) May 26 03:22:46.828356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: May 26 03:22:46.829325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25e572-8f01-42b5-9299-d8059e6cef1e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:46.842771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 780/1551] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:46.844025 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c682c1-8527-4d35-b80e-d8bdee0d104c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.844322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c682c1-8527-4d35-b80e-d8bdee0d104c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.844630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c682c1-8527-4d35-b80e-d8bdee0d104c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.863856 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f2c682c1-8527-4d35-b80e-d8bdee0d104c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.865133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f2c682c1-8527-4d35-b80e-d8bdee0d104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.873662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 781/1552] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.874528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c682c1-8527-4d35-b80e-d8bdee0d104c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:46.884823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c682c1-8527-4d35-b80e-d8bdee0d104c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:46.889492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e27b2-178e-497d-be52-9cf107e7f1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:46.890185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e27b2-178e-497d-be52-9cf107e7f1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.890468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e27b2-178e-497d-be52-9cf107e7f1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.890745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e27b2-178e-497d-be52-9cf107e7f1bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.891486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e27b2-178e-497d-be52-9cf107e7f1bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:46.891795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e27b2-178e-497d-be52-9cf107e7f1bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:46.893474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e27b2-178e-497d-be52-9cf107e7f1bb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:46.905931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 782/1553] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:46.907257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1389b7-931a-4368-8a72-1b3094015f44 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.907544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1389b7-931a-4368-8a72-1b3094015f44 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.907815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1389b7-931a-4368-8a72-1b3094015f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.924318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bda28373-8b29-4dca-be8e-eeed34b423b0 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.925552 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bda28373-8b29-4dca-be8e-eeed34b423b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.925786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ed1389b7-931a-4368-8a72-1b3094015f44 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.926953 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ed1389b7-931a-4368-8a72-1b3094015f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.933871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 772/1554] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.934656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda28373-8b29-4dca-be8e-eeed34b423b0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:46.935889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 783/1555] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.937711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97e25-e11b-44c5-93dc-d139779aeb4b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.938155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97e25-e11b-44c5-93dc-d139779aeb4b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.938584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97e25-e11b-44c5-93dc-d139779aeb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.944867 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda28373-8b29-4dca-be8e-eeed34b423b0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:46.952258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863689d-9027-40d2-9e5d-ac243de67114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:46.952958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863689d-9027-40d2-9e5d-ac243de67114 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.953237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863689d-9027-40d2-9e5d-ac243de67114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.953505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863689d-9027-40d2-9e5d-ac243de67114 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.954220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863689d-9027-40d2-9e5d-ac243de67114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:46.954520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863689d-9027-40d2-9e5d-ac243de67114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:46.956177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863689d-9027-40d2-9e5d-ac243de67114 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:46.958197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-82c97e25-e11b-44c5-93dc-d139779aeb4b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:46.959485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-82c97e25-e11b-44c5-93dc-d139779aeb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:46.967184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 784/1556] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:46.967954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c97e25-e11b-44c5-93dc-d139779aeb4b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:46.971145 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 773/1557] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:46.972043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863689d-9027-40d2-9e5d-ac243de67114 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:46.977810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c97e25-e11b-44c5-93dc-d139779aeb4b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:46.982345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863689d-9027-40d2-9e5d-ac243de67114 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:46.982705 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aafde1-b03c-4770-bbf1-daa68a126b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:46.983364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aafde1-b03c-4770-bbf1-daa68a126b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.983936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aafde1-b03c-4770-bbf1-daa68a126b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.984221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aafde1-b03c-4770-bbf1-daa68a126b4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.984983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aafde1-b03c-4770-bbf1-daa68a126b4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:46.985289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aafde1-b03c-4770-bbf1-daa68a126b4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:46.986842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7079b-e73a-4a8d-ae74-802cf08c19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:46.986974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aafde1-b03c-4770-bbf1-daa68a126b4a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:46.987464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7079b-e73a-4a8d-ae74-802cf08c19a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:46.987742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7079b-e73a-4a8d-ae74-802cf08c19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:46.988011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7079b-e73a-4a8d-ae74-802cf08c19a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:46.988738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7079b-e73a-4a8d-ae74-802cf08c19a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:46.989740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-fad7079b-e73a-4a8d-ae74-802cf08c19a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:22:46.989740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: warnings.warn(msg) May 26 03:22:46.989740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: May 26 03:22:46.990973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7079b-e73a-4a8d-ae74-802cf08c19a5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:46.999681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 785/1558] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:47.000507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aafde1-b03c-4770-bbf1-daa68a126b4a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.010142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aafde1-b03c-4770-bbf1-daa68a126b4a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.014636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582fe8d-3d4b-4697-b109-3cdbcf3402ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.025718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582fe8d-3d4b-4697-b109-3cdbcf3402ee admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.025718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582fe8d-3d4b-4697-b109-3cdbcf3402ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.025718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582fe8d-3d4b-4697-b109-3cdbcf3402ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.025718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582fe8d-3d4b-4697-b109-3cdbcf3402ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:47.025718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582fe8d-3d4b-4697-b109-3cdbcf3402ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.025718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582fe8d-3d4b-4697-b109-3cdbcf3402ee admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.029854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 786/1559] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:47.030670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582fe8d-3d4b-4697-b109-3cdbcf3402ee admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.040089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582fe8d-3d4b-4697-b109-3cdbcf3402ee admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.044582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bda57-3c76-4bcd-abb6-ac4140fcc40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.045190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bda57-3c76-4bcd-abb6-ac4140fcc40e admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.045472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bda57-3c76-4bcd-abb6-ac4140fcc40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.045746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bda57-3c76-4bcd-abb6-ac4140fcc40e admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.046403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bda57-3c76-4bcd-abb6-ac4140fcc40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.048218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bda57-3c76-4bcd-abb6-ac4140fcc40e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.096366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 774/1560] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:46 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.096366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7079b-e73a-4a8d-ae74-802cf08c19a5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.152677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 787/1561] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.152677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb24833-d53c-4023-a6ef-084c54ec393c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.152677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb24833-d53c-4023-a6ef-084c54ec393c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.152677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb24833-d53c-4023-a6ef-084c54ec393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.153429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7079b-e73a-4a8d-ae74-802cf08c19a5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.170065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4fb24833-d53c-4023-a6ef-084c54ec393c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:47.171296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4fb24833-d53c-4023-a6ef-084c54ec393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:47.209171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64417f1d-bbb1-47d8-b227-84baa0ade236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.209834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64417f1d-bbb1-47d8-b227-84baa0ade236 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.210115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64417f1d-bbb1-47d8-b227-84baa0ade236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.210390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64417f1d-bbb1-47d8-b227-84baa0ade236 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.211113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64417f1d-bbb1-47d8-b227-84baa0ade236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:47.211416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64417f1d-bbb1-47d8-b227-84baa0ade236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.213063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64417f1d-bbb1-47d8-b227-84baa0ade236 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.224074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 775/1562] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:47.224965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64417f1d-bbb1-47d8-b227-84baa0ade236 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.236300 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 788/1563] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:47.237144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb24833-d53c-4023-a6ef-084c54ec393c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.240501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64417f1d-bbb1-47d8-b227-84baa0ade236 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.246082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803bd24-c668-4fe8-b290-6edf96fea877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.246716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803bd24-c668-4fe8-b290-6edf96fea877 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.246820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb24833-d53c-4023-a6ef-084c54ec393c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.246997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803bd24-c668-4fe8-b290-6edf96fea877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.247405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803bd24-c668-4fe8-b290-6edf96fea877 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.248121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803bd24-c668-4fe8-b290-6edf96fea877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:47.248461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803bd24-c668-4fe8-b290-6edf96fea877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.250038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803bd24-c668-4fe8-b290-6edf96fea877 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.251180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd9836-a513-4610-8b3b-9f4ff8d909ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.251811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd9836-a513-4610-8b3b-9f4ff8d909ec admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.252091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd9836-a513-4610-8b3b-9f4ff8d909ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.252395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd9836-a513-4610-8b3b-9f4ff8d909ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.253068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd9836-a513-4610-8b3b-9f4ff8d909ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.254974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd9836-a513-4610-8b3b-9f4ff8d909ec admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.262067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 776/1564] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:47.263205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803bd24-c668-4fe8-b290-6edf96fea877 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.272932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803bd24-c668-4fe8-b290-6edf96fea877 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.277426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a93006-1934-4602-aa66-221f2d1fbef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.278049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a93006-1934-4602-aa66-221f2d1fbef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.281128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a93006-1934-4602-aa66-221f2d1fbef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.281128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a93006-1934-4602-aa66-221f2d1fbef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.281128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a93006-1934-4602-aa66-221f2d1fbef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.281128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a93006-1934-4602-aa66-221f2d1fbef1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.291026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:47.326131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 789/1565] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.327014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd9836-a513-4610-8b3b-9f4ff8d909ec admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.332513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:47.387846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd9836-a513-4610-8b3b-9f4ff8d909ec admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.392437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6aeb1-c3df-4d08-9612-79184e680d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.393078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6aeb1-c3df-4d08-9612-79184e680d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.393355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6aeb1-c3df-4d08-9612-79184e680d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.393623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6aeb1-c3df-4d08-9612-79184e680d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.394293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6aeb1-c3df-4d08-9612-79184e680d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.396290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6aeb1-c3df-4d08-9612-79184e680d23 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.416789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 777/1566] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.419241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a93006-1934-4602-aa66-221f2d1fbef1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.477017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a93006-1934-4602-aa66-221f2d1fbef1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.481540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5811-5f61-43d8-a616-9b9a67c9db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.482317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5811-5f61-43d8-a616-9b9a67c9db2b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.482604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5811-5f61-43d8-a616-9b9a67c9db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.482886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5811-5f61-43d8-a616-9b9a67c9db2b admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.483619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5811-5f61-43d8-a616-9b9a67c9db2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.485574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5811-5f61-43d8-a616-9b9a67c9db2b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.514731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 790/1567] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.515596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6aeb1-c3df-4d08-9612-79184e680d23 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.576779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6aeb1-c3df-4d08-9612-79184e680d23 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.581401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999ac8d-1823-45b8-b5f7-a8408c93c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.582060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999ac8d-1823-45b8-b5f7-a8408c93c967 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.582336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999ac8d-1823-45b8-b5f7-a8408c93c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.582608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999ac8d-1823-45b8-b5f7-a8408c93c967 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.583273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999ac8d-1823-45b8-b5f7-a8408c93c967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.584264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-9999ac8d-1823-45b8-b5f7-a8408c93c967 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:22:47.584264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: warnings.warn(msg) May 26 03:22:47.584264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: May 26 03:22:47.585538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999ac8d-1823-45b8-b5f7-a8408c93c967 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.611060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 778/1568] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.611886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5811-5f61-43d8-a616-9b9a67c9db2b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.621806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5811-5f61-43d8-a616-9b9a67c9db2b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.626336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcf43e-2c67-47ca-be9f-491fc9da1e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.626959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf43e-2c67-47ca-be9f-491fc9da1e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.627248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf43e-2c67-47ca-be9f-491fc9da1e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.627529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf43e-2c67-47ca-be9f-491fc9da1e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.628201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcf43e-2c67-47ca-be9f-491fc9da1e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.630134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcf43e-2c67-47ca-be9f-491fc9da1e2b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.707952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 791/1569] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.708746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999ac8d-1823-45b8-b5f7-a8408c93c967 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.717957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999ac8d-1823-45b8-b5f7-a8408c93c967 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.722446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad777-993e-4f83-a6bb-ca5a0352b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.723064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad777-993e-4f83-a6bb-ca5a0352b8ac admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.723345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad777-993e-4f83-a6bb-ca5a0352b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.723618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad777-993e-4f83-a6bb-ca5a0352b8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.724327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedad777-993e-4f83-a6bb-ca5a0352b8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:47.724654 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedad777-993e-4f83-a6bb-ca5a0352b8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.726222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedad777-993e-4f83-a6bb-ca5a0352b8ac admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.739197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 779/1570] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.742637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 792/1571] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:47.742804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcf43e-2c67-47ca-be9f-491fc9da1e2b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.742911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad777-993e-4f83-a6bb-ca5a0352b8ac admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.752340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad777-993e-4f83-a6bb-ca5a0352b8ac admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.805543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcf43e-2c67-47ca-be9f-491fc9da1e2b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.810051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f2679-f3cd-4711-9ac4-397310d59fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.810709 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f2679-f3cd-4711-9ac4-397310d59fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.810991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f2679-f3cd-4711-9ac4-397310d59fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.811264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f2679-f3cd-4711-9ac4-397310d59fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.812204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f2679-f3cd-4711-9ac4-397310d59fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.814149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f2679-f3cd-4711-9ac4-397310d59fcf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.814732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74e2ad-f089-4703-b8d9-6d7013a02929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.815409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74e2ad-f089-4703-b8d9-6d7013a02929 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.815694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74e2ad-f089-4703-b8d9-6d7013a02929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.815969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74e2ad-f089-4703-b8d9-6d7013a02929 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.816679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74e2ad-f089-4703-b8d9-6d7013a02929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.818576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74e2ad-f089-4703-b8d9-6d7013a02929 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.827925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:47.885692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 780/1572] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.886491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f2679-f3cd-4711-9ac4-397310d59fcf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.908651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 793/1573] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:47.909355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74e2ad-f089-4703-b8d9-6d7013a02929 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:47.920359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74e2ad-f089-4703-b8d9-6d7013a02929 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.933786 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:47.949416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f2679-f3cd-4711-9ac4-397310d59fcf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:47.954038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f502ddd-6124-47ff-b187-a39782725828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.954700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f502ddd-6124-47ff-b187-a39782725828 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.954983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f502ddd-6124-47ff-b187-a39782725828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.955258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f502ddd-6124-47ff-b187-a39782725828 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.955996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f502ddd-6124-47ff-b187-a39782725828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.958061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f502ddd-6124-47ff-b187-a39782725828 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:47.976195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398b2f-4f1b-438f-ac43-9d00b0558698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:47.978537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398b2f-4f1b-438f-ac43-9d00b0558698 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:47.978537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398b2f-4f1b-438f-ac43-9d00b0558698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:47.978537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398b2f-4f1b-438f-ac43-9d00b0558698 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:47.979027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37398b2f-4f1b-438f-ac43-9d00b0558698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:47.980767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37398b2f-4f1b-438f-ac43-9d00b0558698 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.101052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 794/1574] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:48.101250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 781/1575] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:47 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:48.102878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f502ddd-6124-47ff-b187-a39782725828 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.103066 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398b2f-4f1b-438f-ac43-9d00b0558698 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.112875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f502ddd-6124-47ff-b187-a39782725828 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.113047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398b2f-4f1b-438f-ac43-9d00b0558698 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.117477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cfc10-29a6-44e7-824f-fd81af2a8a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.118241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfc10-29a6-44e7-824f-fd81af2a8a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.118395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153db5f-4a15-4542-9076-193519e4c031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.118519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfc10-29a6-44e7-824f-fd81af2a8a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.118779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfc10-29a6-44e7-824f-fd81af2a8a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.118968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153db5f-4a15-4542-9076-193519e4c031 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.119255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153db5f-4a15-4542-9076-193519e4c031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.119487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cfc10-29a6-44e7-824f-fd81af2a8a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.119591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153db5f-4a15-4542-9076-193519e4c031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.120235 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153db5f-4a15-4542-9076-193519e4c031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.121098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cfc10-29a6-44e7-824f-fd81af2a8a68 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.121856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153db5f-4a15-4542-9076-193519e4c031 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.134069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 795/1576] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.134259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 782/1577] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.134369 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cfc10-29a6-44e7-824f-fd81af2a8a68 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.134471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153db5f-4a15-4542-9076-193519e4c031 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.141951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cfc10-29a6-44e7-824f-fd81af2a8a68 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.142176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153db5f-4a15-4542-9076-193519e4c031 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.146415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704ca83-5d0e-497c-89c8-09da0ce9ff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.146622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff4ee4-e17d-4f14-8903-f43631d0baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.147053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704ca83-5d0e-497c-89c8-09da0ce9ff9e admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.147248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff4ee4-e17d-4f14-8903-f43631d0baa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.147363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704ca83-5d0e-497c-89c8-09da0ce9ff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.147528 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff4ee4-e17d-4f14-8903-f43631d0baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.147702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704ca83-5d0e-497c-89c8-09da0ce9ff9e admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.147809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff4ee4-e17d-4f14-8903-f43631d0baa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.148923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704ca83-5d0e-497c-89c8-09da0ce9ff9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.149054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff4ee4-e17d-4f14-8903-f43631d0baa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.150802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704ca83-5d0e-497c-89c8-09da0ce9ff9e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.150910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff4ee4-e17d-4f14-8903-f43631d0baa0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.255480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 796/1578] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:48 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:48.256331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704ca83-5d0e-497c-89c8-09da0ce9ff9e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.265583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704ca83-5d0e-497c-89c8-09da0ce9ff9e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.270047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9fdb1-01c7-48d5-89cf-dd85ae489eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.270672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9fdb1-01c7-48d5-89cf-dd85ae489eea admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.270956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9fdb1-01c7-48d5-89cf-dd85ae489eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.271232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9fdb1-01c7-48d5-89cf-dd85ae489eea admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.271896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9fdb1-01c7-48d5-89cf-dd85ae489eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.274379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9fdb1-01c7-48d5-89cf-dd85ae489eea admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.292598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 783/1579] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:48 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:48.293549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff4ee4-e17d-4f14-8903-f43631d0baa0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.353190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff4ee4-e17d-4f14-8903-f43631d0baa0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.357731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db944-fbb2-437c-8fd9-a79b3602932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.358375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db944-fbb2-437c-8fd9-a79b3602932e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.358652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db944-fbb2-437c-8fd9-a79b3602932e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.358920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db944-fbb2-437c-8fd9-a79b3602932e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.359633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1db944-fbb2-437c-8fd9-a79b3602932e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.361262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1db944-fbb2-437c-8fd9-a79b3602932e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.371047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 784/1580] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.374287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db944-fbb2-437c-8fd9-a79b3602932e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.379873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 797/1581] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:48 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:48.379873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9fdb1-01c7-48d5-89cf-dd85ae489eea admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.382544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9fdb1-01c7-48d5-89cf-dd85ae489eea admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.383272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db944-fbb2-437c-8fd9-a79b3602932e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.387159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ef21-2fc7-4774-aec2-038941d16273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.387810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ef21-2fc7-4774-aec2-038941d16273 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.387984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f916fbe-7e9d-4bc7-bf94-928fcee50ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.388111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ef21-2fc7-4774-aec2-038941d16273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.388391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ef21-2fc7-4774-aec2-038941d16273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.388649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916fbe-7e9d-4bc7-bf94-928fcee50ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.388929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916fbe-7e9d-4bc7-bf94-928fcee50ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.389110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ef21-2fc7-4774-aec2-038941d16273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.389214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916fbe-7e9d-4bc7-bf94-928fcee50ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.389897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f916fbe-7e9d-4bc7-bf94-928fcee50ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.390695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ef21-2fc7-4774-aec2-038941d16273 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.391509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f916fbe-7e9d-4bc7-bf94-928fcee50ee3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.401314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 798/1582] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.405179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ef21-2fc7-4774-aec2-038941d16273 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.405327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 785/1583] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.405327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f916fbe-7e9d-4bc7-bf94-928fcee50ee3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.413205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f916fbe-7e9d-4bc7-bf94-928fcee50ee3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.413495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ef21-2fc7-4774-aec2-038941d16273 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.418499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab18ef-fa49-4550-b163-366360af4ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.418649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664acbfd-2cf8-42f4-82af-e8e3b1d3b831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.419146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab18ef-fa49-4550-b163-366360af4ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.419315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664acbfd-2cf8-42f4-82af-e8e3b1d3b831 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.419427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab18ef-fa49-4550-b163-366360af4ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.419599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664acbfd-2cf8-42f4-82af-e8e3b1d3b831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.419706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab18ef-fa49-4550-b163-366360af4ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.419875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664acbfd-2cf8-42f4-82af-e8e3b1d3b831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.420432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab18ef-fa49-4550-b163-366360af4ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.420606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664acbfd-2cf8-42f4-82af-e8e3b1d3b831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.422029 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab18ef-fa49-4550-b163-366360af4ad6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.422181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664acbfd-2cf8-42f4-82af-e8e3b1d3b831 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.432161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 799/1584] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.432991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664acbfd-2cf8-42f4-82af-e8e3b1d3b831 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.436750 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 786/1585] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.437538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab18ef-fa49-4550-b163-366360af4ad6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.444912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664acbfd-2cf8-42f4-82af-e8e3b1d3b831 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.449245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab18ef-fa49-4550-b163-366360af4ad6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.449953 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb0ccc-06b6-4c37-bc2f-925512cf10d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.450588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb0ccc-06b6-4c37-bc2f-925512cf10d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.450868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb0ccc-06b6-4c37-bc2f-925512cf10d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.451141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb0ccc-06b6-4c37-bc2f-925512cf10d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.451874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb0ccc-06b6-4c37-bc2f-925512cf10d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.453448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb0ccc-06b6-4c37-bc2f-925512cf10d5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.453651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b061a-12ce-4676-babf-cf8e4a0e837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.454282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b061a-12ce-4676-babf-cf8e4a0e837a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.454567 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b061a-12ce-4676-babf-cf8e4a0e837a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.454842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b061a-12ce-4676-babf-cf8e4a0e837a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.455514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b061a-12ce-4676-babf-cf8e4a0e837a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.457447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b061a-12ce-4676-babf-cf8e4a0e837a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.464182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 800/1586] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.465088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb0ccc-06b6-4c37-bc2f-925512cf10d5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.474969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb0ccc-06b6-4c37-bc2f-925512cf10d5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.479628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948784da-6901-4fe3-8c79-2e5985cc63f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.482862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948784da-6901-4fe3-8c79-2e5985cc63f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.482862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948784da-6901-4fe3-8c79-2e5985cc63f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.482862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948784da-6901-4fe3-8c79-2e5985cc63f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.482862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948784da-6901-4fe3-8c79-2e5985cc63f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.483211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948784da-6901-4fe3-8c79-2e5985cc63f4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.493013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 801/1587] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.493842 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948784da-6901-4fe3-8c79-2e5985cc63f4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.503465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948784da-6901-4fe3-8c79-2e5985cc63f4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.511232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f43203-7e5a-4474-b329-a5a29a15d1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.511232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f43203-7e5a-4474-b329-a5a29a15d1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.511232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f43203-7e5a-4474-b329-a5a29a15d1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.511232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f43203-7e5a-4474-b329-a5a29a15d1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.511622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f43203-7e5a-4474-b329-a5a29a15d1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.512113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f43203-7e5a-4474-b329-a5a29a15d1c7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.521830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 802/1588] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.522579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f43203-7e5a-4474-b329-a5a29a15d1c7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.532379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f43203-7e5a-4474-b329-a5a29a15d1c7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.536956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840e7de-ca51-4e12-88a8-e5759a5488f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.537573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840e7de-ca51-4e12-88a8-e5759a5488f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.537860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840e7de-ca51-4e12-88a8-e5759a5488f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.540329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840e7de-ca51-4e12-88a8-e5759a5488f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.540329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840e7de-ca51-4e12-88a8-e5759a5488f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.540548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840e7de-ca51-4e12-88a8-e5759a5488f0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.550529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 803/1589] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.551282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840e7de-ca51-4e12-88a8-e5759a5488f0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.560440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840e7de-ca51-4e12-88a8-e5759a5488f0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.565339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d9305-c408-48e4-b966-4f7d2cf78a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.568750 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 787/1590] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:48 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:48.580714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d9305-c408-48e4-b966-4f7d2cf78a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.580714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d9305-c408-48e4-b966-4f7d2cf78a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.580714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d9305-c408-48e4-b966-4f7d2cf78a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.581031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b061a-12ce-4676-babf-cf8e4a0e837a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.581117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d9305-c408-48e4-b966-4f7d2cf78a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.581117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d9305-c408-48e4-b966-4f7d2cf78a71 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.581307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b061a-12ce-4676-babf-cf8e4a0e837a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.581404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 804/1591] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.581404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d9305-c408-48e4-b966-4f7d2cf78a71 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.581560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19403bd1-5bc7-4d79-b198-a325bdfe83c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.582422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19403bd1-5bc7-4d79-b198-a325bdfe83c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.582705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19403bd1-5bc7-4d79-b198-a325bdfe83c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.582978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19403bd1-5bc7-4d79-b198-a325bdfe83c6 admin admin] PATH_INFO: `/v3/projects/a6c82030994c42f2be7027dd2c352efd/users/ce295e83877040b2869cd06409d93c26/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.592091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d9305-c408-48e4-b966-4f7d2cf78a71 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.596727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b083-c9c0-4e83-8d70-36007897c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.597676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b083-c9c0-4e83-8d70-36007897c9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.597959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b083-c9c0-4e83-8d70-36007897c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.598235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b083-c9c0-4e83-8d70-36007897c9ea admin admin] PATH_INFO: `/v3/projects/b459e0ce93cc4d1d925ad9e106b5bc67/users/ca42c73a71d2422c9aaefad29e76cfe4/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.598556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19403bd1-5bc7-4d79-b198-a325bdfe83c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c82030994c42f2be7027dd2c352efd, user_id=ce295e83877040b2869cd06409d93c26, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.599598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-19403bd1-5bc7-4d79-b198-a325bdfe83c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:22:48.599598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: warnings.warn(msg) May 26 03:22:48.599598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: May 26 03:22:48.601553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19403bd1-5bc7-4d79-b198-a325bdfe83c6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.612738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7b083-c9c0-4e83-8d70-36007897c9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b459e0ce93cc4d1d925ad9e106b5bc67, user_id=ca42c73a71d2422c9aaefad29e76cfe4, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.617072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7b083-c9c0-4e83-8d70-36007897c9ea admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.690876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 788/1592] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:48 2022] PUT /identity/v3/projects/a6c82030994c42f2be7027dd2c352efd/users/ce295e83877040b2869cd06409d93c26/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:48.691704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19403bd1-5bc7-4d79-b198-a325bdfe83c6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.698465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:48.705200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 805/1593] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:48 2022] PUT /identity/v3/projects/b459e0ce93cc4d1d925ad9e106b5bc67/users/ca42c73a71d2422c9aaefad29e76cfe4/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:48.705200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b083-c9c0-4e83-8d70-36007897c9ea admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.725850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:48.752389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19403bd1-5bc7-4d79-b198-a325bdfe83c6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.765690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b083-c9c0-4e83-8d70-36007897c9ea admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.770272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a934ac-17bb-4ed5-bc15-a899db932f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.771152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a934ac-17bb-4ed5-bc15-a899db932f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.771434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a934ac-17bb-4ed5-bc15-a899db932f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.771711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a934ac-17bb-4ed5-bc15-a899db932f9c admin admin] PATH_INFO: `/v3/projects/4e782993fa5b431b8a74c8c9bd400d64/users/f1306e17dbfe4868a35b8570055d6b4c/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.786913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a934ac-17bb-4ed5-bc15-a899db932f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e782993fa5b431b8a74c8c9bd400d64, user_id=f1306e17dbfe4868a35b8570055d6b4c, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.789622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a934ac-17bb-4ed5-bc15-a899db932f9c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.809117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0bf7e-02bf-4bc4-a07a-d747855fd23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.809823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0bf7e-02bf-4bc4-a07a-d747855fd23f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.810108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0bf7e-02bf-4bc4-a07a-d747855fd23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.810386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0bf7e-02bf-4bc4-a07a-d747855fd23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.811139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0bf7e-02bf-4bc4-a07a-d747855fd23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.813162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0bf7e-02bf-4bc4-a07a-d747855fd23f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.824172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 789/1594] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.824997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0bf7e-02bf-4bc4-a07a-d747855fd23f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.834174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0bf7e-02bf-4bc4-a07a-d747855fd23f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.839513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 806/1595] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:48 2022] PUT /identity/v3/projects/4e782993fa5b431b8a74c8c9bd400d64/users/f1306e17dbfe4868a35b8570055d6b4c/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:48.840143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a934ac-17bb-4ed5-bc15-a899db932f9c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.891287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741ec3b-29f4-47b2-baa3-434fa568ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.891986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741ec3b-29f4-47b2-baa3-434fa568ab8c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.892268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741ec3b-29f4-47b2-baa3-434fa568ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.892578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741ec3b-29f4-47b2-baa3-434fa568ab8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.893299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741ec3b-29f4-47b2-baa3-434fa568ab8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.894934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741ec3b-29f4-47b2-baa3-434fa568ab8c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.900538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a934ac-17bb-4ed5-bc15-a899db932f9c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.907734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 790/1596] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.907885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75616162-6670-4f16-908a-e619bddbbdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.908024 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741ec3b-29f4-47b2-baa3-434fa568ab8c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.908141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616162-6670-4f16-908a-e619bddbbdff admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.908141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616162-6670-4f16-908a-e619bddbbdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.908141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75616162-6670-4f16-908a-e619bddbbdff admin admin] PATH_INFO: `/v3/projects/b2043ed2909749b285cbf780e30fa943/users/0f64029bc0664a158b32340b3cbdb311/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.914730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741ec3b-29f4-47b2-baa3-434fa568ab8c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.919351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83312115-fea1-412a-bdd0-eb3323654f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.919987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83312115-fea1-412a-bdd0-eb3323654f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.920413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83312115-fea1-412a-bdd0-eb3323654f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.920698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83312115-fea1-412a-bdd0-eb3323654f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.921410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83312115-fea1-412a-bdd0-eb3323654f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.921770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75616162-6670-4f16-908a-e619bddbbdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2043ed2909749b285cbf780e30fa943, user_id=0f64029bc0664a158b32340b3cbdb311, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.923061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83312115-fea1-412a-bdd0-eb3323654f6f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.924440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75616162-6670-4f16-908a-e619bddbbdff admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:48.933560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 791/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:48.934316 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83312115-fea1-412a-bdd0-eb3323654f6f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:48.943698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83312115-fea1-412a-bdd0-eb3323654f6f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:48.948818 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b41007-b8c6-4e21-bf33-f4772c79c4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:48.949648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b41007-b8c6-4e21-bf33-f4772c79c4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:48.949929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b41007-b8c6-4e21-bf33-f4772c79c4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:48.950204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b41007-b8c6-4e21-bf33-f4772c79c4a2 admin admin] PATH_INFO: `/v3/projects/be73da2c7b294039bc8d99310ff64e3a/users/1fbe40b7cb2046809bf6a890a12de4d3/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:48.964328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b41007-b8c6-4e21-bf33-f4772c79c4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be73da2c7b294039bc8d99310ff64e3a, user_id=1fbe40b7cb2046809bf6a890a12de4d3, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:48.968123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b41007-b8c6-4e21-bf33-f4772c79c4a2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.022741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 807/1598] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:48 2022] PUT /identity/v3/projects/b2043ed2909749b285cbf780e30fa943/users/0f64029bc0664a158b32340b3cbdb311/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:49.024166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d8b8-0c63-4b51-81c7-64beaa892db4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.024487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d8b8-0c63-4b51-81c7-64beaa892db4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.024762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d8b8-0c63-4b51-81c7-64beaa892db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.041213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3ae9d8b8-0c63-4b51-81c7-64beaa892db4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:49.042387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3ae9d8b8-0c63-4b51-81c7-64beaa892db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:49.079411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 792/1599] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:48 2022] PUT /identity/v3/projects/be73da2c7b294039bc8d99310ff64e3a/users/1fbe40b7cb2046809bf6a890a12de4d3/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:49.081307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a206f0d-42d5-45ca-91d7-72627c244ad0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.081596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a206f0d-42d5-45ca-91d7-72627c244ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.081878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a206f0d-42d5-45ca-91d7-72627c244ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.100328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 808/1600] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:49.103637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d8b8-0c63-4b51-81c7-64beaa892db4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.107811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:49.109596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6a206f0d-42d5-45ca-91d7-72627c244ad0 None None] MFA Rules not processed for user `ca42c73a71d2422c9aaefad29e76cfe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:49.111064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6a206f0d-42d5-45ca-91d7-72627c244ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:49.111947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d8b8-0c63-4b51-81c7-64beaa892db4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.137358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:49.167850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a015cd-9557-4a42-bc51-03360a615e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.168834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a015cd-9557-4a42-bc51-03360a615e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.169187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a015cd-9557-4a42-bc51-03360a615e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.169460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a015cd-9557-4a42-bc51-03360a615e8a admin admin] PATH_INFO: `/v3/projects/2c37889b5d444642b23ce335624b7e09/users/1ab6c2789921428bbc7d35d0a2978aba/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.174060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 793/1601] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:49.175339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47933d19-53ba-45cf-8ee0-9b267305b7da None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.175628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47933d19-53ba-45cf-8ee0-9b267305b7da None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.175904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47933d19-53ba-45cf-8ee0-9b267305b7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.184439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a015cd-9557-4a42-bc51-03360a615e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c37889b5d444642b23ce335624b7e09, user_id=1ab6c2789921428bbc7d35d0a2978aba, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.187518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a015cd-9557-4a42-bc51-03360a615e8a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.193533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-47933d19-53ba-45cf-8ee0-9b267305b7da None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:49.194721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-47933d19-53ba-45cf-8ee0-9b267305b7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:49.202792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 794/1602] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:49.203539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47933d19-53ba-45cf-8ee0-9b267305b7da None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.212643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47933d19-53ba-45cf-8ee0-9b267305b7da None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.217123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b91e99-eaac-4637-9469-2c3eef15de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.223019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b91e99-eaac-4637-9469-2c3eef15de9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.223019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b91e99-eaac-4637-9469-2c3eef15de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.223019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b91e99-eaac-4637-9469-2c3eef15de9d admin admin] PATH_INFO: `/v3/projects/d5eb7896863146b5b36593e7c6e49c1b/users/793667257d4448e1813ed3ac6e9b82c0/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.232926 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b91e99-eaac-4637-9469-2c3eef15de9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5eb7896863146b5b36593e7c6e49c1b, user_id=793667257d4448e1813ed3ac6e9b82c0, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.235610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b91e99-eaac-4637-9469-2c3eef15de9d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.262447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 809/1603] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:49 2022] PUT /identity/v3/projects/2c37889b5d444642b23ce335624b7e09/users/1ab6c2789921428bbc7d35d0a2978aba/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:49.263269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a015cd-9557-4a42-bc51-03360a615e8a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.319657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 795/1604] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:49 2022] PUT /identity/v3/projects/d5eb7896863146b5b36593e7c6e49c1b/users/793667257d4448e1813ed3ac6e9b82c0/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:49.321175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5c91c-3f0d-49cf-a9f4-72b492e507bf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.321463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5c91c-3f0d-49cf-a9f4-72b492e507bf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.321740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5c91c-3f0d-49cf-a9f4-72b492e507bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.332543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a015cd-9557-4a42-bc51-03360a615e8a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.338425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-76a5c91c-3f0d-49cf-a9f4-72b492e507bf None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:49.339624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-76a5c91c-3f0d-49cf-a9f4-72b492e507bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:49.388170 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d63f8-c8f4-4545-ba9a-ea40f43de00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.388874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d63f8-c8f4-4545-ba9a-ea40f43de00f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.389158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d63f8-c8f4-4545-ba9a-ea40f43de00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.389438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d63f8-c8f4-4545-ba9a-ea40f43de00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.390278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d63f8-c8f4-4545-ba9a-ea40f43de00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.391865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d63f8-c8f4-4545-ba9a-ea40f43de00f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.399886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 796/1605] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:49.401578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c6a36-6506-42e6-876d-9890986a1e3d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.401721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 810/1606] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:49.401899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c6a36-6506-42e6-876d-9890986a1e3d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.402334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c6a36-6506-42e6-876d-9890986a1e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.402443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d63f8-c8f4-4545-ba9a-ea40f43de00f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.429128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-675c6a36-6506-42e6-876d-9890986a1e3d None None] MFA Rules not processed for user `1fbe40b7cb2046809bf6a890a12de4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:49.430925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-675c6a36-6506-42e6-876d-9890986a1e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:49.436612 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:49.456559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d63f8-c8f4-4545-ba9a-ea40f43de00f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.460465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddb7bb-d8ba-476a-8ed6-1e3f2444874a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.461151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddb7bb-d8ba-476a-8ed6-1e3f2444874a service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.461431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddb7bb-d8ba-476a-8ed6-1e3f2444874a service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.461708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddb7bb-d8ba-476a-8ed6-1e3f2444874a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.471988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddb7bb-d8ba-476a-8ed6-1e3f2444874a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.473453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddb7bb-d8ba-476a-8ed6-1e3f2444874a service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.483332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 811/1607] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:49.486016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddb7bb-d8ba-476a-8ed6-1e3f2444874a service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.495947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddb7bb-d8ba-476a-8ed6-1e3f2444874a service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.501662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 797/1608] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:49.501981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232bc61-b50d-4a63-bf6a-c99194d4d5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.502649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232bc61-b50d-4a63-bf6a-c99194d4d5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.502939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232bc61-b50d-4a63-bf6a-c99194d4d5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.503215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232bc61-b50d-4a63-bf6a-c99194d4d5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.504241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232bc61-b50d-4a63-bf6a-c99194d4d5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.506233 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232bc61-b50d-4a63-bf6a-c99194d4d5a2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.509228 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c6a36-6506-42e6-876d-9890986a1e3d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.520012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c6a36-6506-42e6-876d-9890986a1e3d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.524149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c89cc3-28e4-4272-bfec-d4818256ac01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.524841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c89cc3-28e4-4272-bfec-d4818256ac01 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.525124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c89cc3-28e4-4272-bfec-d4818256ac01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.525400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c89cc3-28e4-4272-bfec-d4818256ac01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.535298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c89cc3-28e4-4272-bfec-d4818256ac01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.536766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c89cc3-28e4-4272-bfec-d4818256ac01 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.546480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 798/1609] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:49.549016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dbe4a-e9de-4e17-8d11-a323df13e9ff None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.549304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dbe4a-e9de-4e17-8d11-a323df13e9ff None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.549578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dbe4a-e9de-4e17-8d11-a323df13e9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.574033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:49.576849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7b9dbe4a-e9de-4e17-8d11-a323df13e9ff None None] MFA Rules not processed for user `1ab6c2789921428bbc7d35d0a2978aba`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:49.578039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7b9dbe4a-e9de-4e17-8d11-a323df13e9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:49.616936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 812/1610] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:49.618320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011694d-5f81-4350-abd2-c72f0604d99a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.619003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011694d-5f81-4350-abd2-c72f0604d99a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.619542 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011694d-5f81-4350-abd2-c72f0604d99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.650610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 799/1611] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:49.650610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dbe4a-e9de-4e17-8d11-a323df13e9ff None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.655630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a011694d-5f81-4350-abd2-c72f0604d99a None None] MFA Rules not processed for user `793667257d4448e1813ed3ac6e9b82c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:49.657317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a011694d-5f81-4350-abd2-c72f0604d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:49.659655 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dbe4a-e9de-4e17-8d11-a323df13e9ff None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.719413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455768e7-c59c-41b4-9a3d-fb8ca6ec8097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.720441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455768e7-c59c-41b4-9a3d-fb8ca6ec8097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.720826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455768e7-c59c-41b4-9a3d-fb8ca6ec8097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.721206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455768e7-c59c-41b4-9a3d-fb8ca6ec8097 admin admin] PATH_INFO: `/v3/projects/5850c4b4df9d4118b43071bb60f3255f/users/2c76c711d3d84884babe858e0c0a90fc/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.736810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455768e7-c59c-41b4-9a3d-fb8ca6ec8097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5850c4b4df9d4118b43071bb60f3255f, user_id=2c76c711d3d84884babe858e0c0a90fc, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.739725 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455768e7-c59c-41b4-9a3d-fb8ca6ec8097 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.751705 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 813/1612] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:49.755638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011694d-5f81-4350-abd2-c72f0604d99a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.812366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011694d-5f81-4350-abd2-c72f0604d99a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.816108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d31dc-4ebe-4090-9449-537b737bd7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.816783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d31dc-4ebe-4090-9449-537b737bd7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.817063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d31dc-4ebe-4090-9449-537b737bd7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.817332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d31dc-4ebe-4090-9449-537b737bd7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.826375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d31dc-4ebe-4090-9449-537b737bd7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.827729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d31dc-4ebe-4090-9449-537b737bd7f9 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.838297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 814/1613] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:49.846851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d1bd5-58dc-473e-b84f-c51007c84de1 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.846851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d1bd5-58dc-473e-b84f-c51007c84de1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.846851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d1bd5-58dc-473e-b84f-c51007c84de1 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.847246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 800/1614] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:49 2022] PUT /identity/v3/projects/5850c4b4df9d4118b43071bb60f3255f/users/2c76c711d3d84884babe858e0c0a90fc/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:49.847512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 815/1615] 10.222.0.15 () {54 vars in 961 bytes} [Thu May 26 03:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:22:49.847512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d1bd5-58dc-473e-b84f-c51007c84de1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.852545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455768e7-c59c-41b4-9a3d-fb8ca6ec8097 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:49.893206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:49.905458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d1bd5-58dc-473e-b84f-c51007c84de1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.909895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a40d0-0cbe-4da3-84ad-c88e0e224c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.909895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a40d0-0cbe-4da3-84ad-c88e0e224c14 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.910146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a40d0-0cbe-4da3-84ad-c88e0e224c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.910430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a40d0-0cbe-4da3-84ad-c88e0e224c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.919405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455768e7-c59c-41b4-9a3d-fb8ca6ec8097 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:49.924169 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44497df9-fa0f-4121-a24d-e713be347ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:49.924944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44497df9-fa0f-4121-a24d-e713be347ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.925360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44497df9-fa0f-4121-a24d-e713be347ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.925644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44497df9-fa0f-4121-a24d-e713be347ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.926351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44497df9-fa0f-4121-a24d-e713be347ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.928447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44497df9-fa0f-4121-a24d-e713be347ce6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.969107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a40d0-0cbe-4da3-84ad-c88e0e224c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:49.970535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a40d0-0cbe-4da3-84ad-c88e0e224c14 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:49.980049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 816/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:49.982283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c27dd-7f81-47bd-a557-574edad1ec4d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.982588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c27dd-7f81-47bd-a557-574edad1ec4d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.982860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c27dd-7f81-47bd-a557-574edad1ec4d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:49.984287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 817/1617] 10.222.0.15 () {54 vars in 961 bytes} [Thu May 26 03:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:22:49.990002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1fc93-981a-4292-9a4b-b072a8b7d275 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:49.990272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1fc93-981a-4292-9a4b-b072a8b7d275 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:49.990548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1fc93-981a-4292-9a4b-b072a8b7d275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.021869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d1d1fc93-981a-4292-9a4b-b072a8b7d275 None None] MFA Rules not processed for user `2c76c711d3d84884babe858e0c0a90fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:50.023949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d1d1fc93-981a-4292-9a4b-b072a8b7d275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:50.033281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 801/1618] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:50.035389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da9dca-96f8-49ae-81b0-9e4e4545c78f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.036538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da9dca-96f8-49ae-81b0-9e4e4545c78f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.036538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da9dca-96f8-49ae-81b0-9e4e4545c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.055722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-75da9dca-96f8-49ae-81b0-9e4e4545c78f None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:50.059380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-75da9dca-96f8-49ae-81b0-9e4e4545c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:50.121617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 818/1619] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:50.121617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3053f-0ab7-4e42-89b0-814280a4633c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.121942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3053f-0ab7-4e42-89b0-814280a4633c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.122022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3053f-0ab7-4e42-89b0-814280a4633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.157175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-07c3053f-0ab7-4e42-89b0-814280a4633c None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:50.158409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-07c3053f-0ab7-4e42-89b0-814280a4633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:50.161586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 802/1620] 10.222.0.15 () {58 vars in 1058 bytes} [Thu May 26 03:22:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:50.162826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da9dca-96f8-49ae-81b0-9e4e4545c78f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:50.177000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da9dca-96f8-49ae-81b0-9e4e4545c78f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:50.182465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b577312-eae9-4d15-bf56-2257ca9a23be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:50.183456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b577312-eae9-4d15-bf56-2257ca9a23be admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.184482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 819/1621] 10.222.0.15 () {58 vars in 1058 bytes} [Thu May 26 03:22:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:50.185250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3053f-0ab7-4e42-89b0-814280a4633c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:50.198000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b577312-eae9-4d15-bf56-2257ca9a23be admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.198540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b577312-eae9-4d15-bf56-2257ca9a23be admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.199288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3053f-0ab7-4e42-89b0-814280a4633c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:50.199768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b577312-eae9-4d15-bf56-2257ca9a23be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:50.202013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b577312-eae9-4d15-bf56-2257ca9a23be admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:50.205141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f55cbb-5fd3-4f7f-8e9d-578acd25271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:50.208108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f55cbb-5fd3-4f7f-8e9d-578acd25271b admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.208108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f55cbb-5fd3-4f7f-8e9d-578acd25271b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.208108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f55cbb-5fd3-4f7f-8e9d-578acd25271b admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.209397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f55cbb-5fd3-4f7f-8e9d-578acd25271b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:50.212441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f55cbb-5fd3-4f7f-8e9d-578acd25271b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:50.215770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 803/1622] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:50.217077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b577312-eae9-4d15-bf56-2257ca9a23be admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:50.237152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b577312-eae9-4d15-bf56-2257ca9a23be admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:50.244379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074140df-7fcf-4203-a41d-837f191d8139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:50.244826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074140df-7fcf-4203-a41d-837f191d8139 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.245168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074140df-7fcf-4203-a41d-837f191d8139 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.245518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074140df-7fcf-4203-a41d-837f191d8139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.321910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 820/1623] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:50 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:50.326507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074140df-7fcf-4203-a41d-837f191d8139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:50.328906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074140df-7fcf-4203-a41d-837f191d8139 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:50.335922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f55cbb-5fd3-4f7f-8e9d-578acd25271b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:50.340337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 804/1624] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:50.342341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074140df-7fcf-4203-a41d-837f191d8139 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:50.356035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074140df-7fcf-4203-a41d-837f191d8139 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:50.440454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c88f33-35b3-4dd0-a2fe-f4b0542474cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:50.441718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c88f33-35b3-4dd0-a2fe-f4b0542474cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.442181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c88f33-35b3-4dd0-a2fe-f4b0542474cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.442621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c88f33-35b3-4dd0-a2fe-f4b0542474cb admin admin] PATH_INFO: `/v3/projects/83f53df5ce054561b6c93df8bdd0fbc8/users/6e463e64c76042daa2f15c5f00fef19b/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.459388 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c88f33-35b3-4dd0-a2fe-f4b0542474cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f53df5ce054561b6c93df8bdd0fbc8, user_id=6e463e64c76042daa2f15c5f00fef19b, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:50.464617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c88f33-35b3-4dd0-a2fe-f4b0542474cb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:50.478013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f55cbb-5fd3-4f7f-8e9d-578acd25271b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:50.485794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:50.489516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1141e2c-7aba-4ed5-9937-87b2e72ab5ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:50.493275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1141e2c-7aba-4ed5-9937-87b2e72ab5ac service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.493275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1141e2c-7aba-4ed5-9937-87b2e72ab5ac service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.493275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1141e2c-7aba-4ed5-9937-87b2e72ab5ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.588919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 805/1625] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:50 2022] PUT /identity/v3/projects/83f53df5ce054561b6c93df8bdd0fbc8/users/6e463e64c76042daa2f15c5f00fef19b/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:50.590267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c88f33-35b3-4dd0-a2fe-f4b0542474cb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:50.607833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1141e2c-7aba-4ed5-9937-87b2e72ab5ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:50.613392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1141e2c-7aba-4ed5-9937-87b2e72ab5ac service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:50.634124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 821/1626] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:50.634997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1141e2c-7aba-4ed5-9937-87b2e72ab5ac service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:50.657584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1141e2c-7aba-4ed5-9937-87b2e72ab5ac service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:50.678855 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c88f33-35b3-4dd0-a2fe-f4b0542474cb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:50.693772 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881001b-6fd6-4a65-bd0a-fdbc96b12921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:50.694507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881001b-6fd6-4a65-bd0a-fdbc96b12921 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.694793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881001b-6fd6-4a65-bd0a-fdbc96b12921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.698691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881001b-6fd6-4a65-bd0a-fdbc96b12921 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.699439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881001b-6fd6-4a65-bd0a-fdbc96b12921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:50.703804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881001b-6fd6-4a65-bd0a-fdbc96b12921 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:50.748797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595414a-026a-4699-9b94-e88438b74659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:50.749594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595414a-026a-4699-9b94-e88438b74659 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.749738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595414a-026a-4699-9b94-e88438b74659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.750009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595414a-026a-4699-9b94-e88438b74659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.750731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595414a-026a-4699-9b94-e88438b74659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:50.752492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595414a-026a-4699-9b94-e88438b74659 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:50.766186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 822/1627] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:50.766186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3cda8-5a82-4909-bb8b-f6632e83b4dc None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.766186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3cda8-5a82-4909-bb8b-f6632e83b4dc None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.766186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3cda8-5a82-4909-bb8b-f6632e83b4dc None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.766664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 823/1628] 10.222.0.15 () {54 vars in 912 bytes} [Thu May 26 03:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:22:50.771525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3cda8-5a82-4909-bb8b-f6632e83b4dc None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:50.790351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3cda8-5a82-4909-bb8b-f6632e83b4dc None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:50.795007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc621e97-dd5f-40b4-a2a8-c66007d93c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:50.802135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621e97-dd5f-40b4-a2a8-c66007d93c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.802500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621e97-dd5f-40b4-a2a8-c66007d93c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.802849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621e97-dd5f-40b4-a2a8-c66007d93c05 admin admin] PATH_INFO: `/v3/projects/83f53df5ce054561b6c93df8bdd0fbc8/users/6e463e64c76042daa2f15c5f00fef19b/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.806311 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc621e97-dd5f-40b4-a2a8-c66007d93c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f53df5ce054561b6c93df8bdd0fbc8, user_id=6e463e64c76042daa2f15c5f00fef19b, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:50.807802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:50.811199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc621e97-dd5f-40b4-a2a8-c66007d93c05 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:50.822713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 824/1629] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:50 2022] PUT /identity/v3/projects/83f53df5ce054561b6c93df8bdd0fbc8/users/6e463e64c76042daa2f15c5f00fef19b/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:50.832596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b657179-c5f2-4eb9-9f4a-6c21f9122cb9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.832596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b657179-c5f2-4eb9-9f4a-6c21f9122cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.832596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b657179-c5f2-4eb9-9f4a-6c21f9122cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.864558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8b657179-c5f2-4eb9-9f4a-6c21f9122cb9 None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:50.865948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8b657179-c5f2-4eb9-9f4a-6c21f9122cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:50.869665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 806/1630] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:50 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:50.871030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631ab75-b779-4db0-b69e-ad1fe8d2eaf2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:50.873279 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631ab75-b779-4db0-b69e-ad1fe8d2eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:50.873606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631ab75-b779-4db0-b69e-ad1fe8d2eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:50.934754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9631ab75-b779-4db0-b69e-ad1fe8d2eaf2 None None] MFA Rules not processed for user `6e463e64c76042daa2f15c5f00fef19b`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:50.948342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9631ab75-b779-4db0-b69e-ad1fe8d2eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:50.966116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 825/1631] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:22:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:50.967235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b657179-c5f2-4eb9-9f4a-6c21f9122cb9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:51.095365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 807/1632] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:51.096134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631ab75-b779-4db0-b69e-ad1fe8d2eaf2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:51.124206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b657179-c5f2-4eb9-9f4a-6c21f9122cb9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:51.140360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534adf60-301f-4b19-a544-c881361c2743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:51.140360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534adf60-301f-4b19-a544-c881361c2743 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.140360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534adf60-301f-4b19-a544-c881361c2743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.140852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534adf60-301f-4b19-a544-c881361c2743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.140952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:51.141494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534adf60-301f-4b19-a544-c881361c2743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:51.143339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534adf60-301f-4b19-a544-c881361c2743 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:51.154185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 826/1633] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:51.155493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24143e-9b1b-4771-b7ea-a6b79cc69de1 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.155781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24143e-9b1b-4771-b7ea-a6b79cc69de1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.156072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24143e-9b1b-4771-b7ea-a6b79cc69de1 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.157872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 827/1634] 10.222.0.15 () {54 vars in 912 bytes} [Thu May 26 03:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:22:51.158575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24143e-9b1b-4771-b7ea-a6b79cc69de1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:51.168447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631ab75-b779-4db0-b69e-ad1fe8d2eaf2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:51.171652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24143e-9b1b-4771-b7ea-a6b79cc69de1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:51.172444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0666065-996e-4f80-ba7b-7e800117aa42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:51.173125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0666065-996e-4f80-ba7b-7e800117aa42 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.173432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0666065-996e-4f80-ba7b-7e800117aa42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.173739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0666065-996e-4f80-ba7b-7e800117aa42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.176400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645696b-18ae-4174-ad2e-e38989216319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:51.177249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645696b-18ae-4174-ad2e-e38989216319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.177631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645696b-18ae-4174-ad2e-e38989216319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.177914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645696b-18ae-4174-ad2e-e38989216319 admin admin] PATH_INFO: `/v3/projects/14ce2d233e964fedabaf54c0ad8ef2e8/users/427d7030d11b47e8a5661e91eb3e58fb/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.184013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0666065-996e-4f80-ba7b-7e800117aa42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:51.185497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0666065-996e-4f80-ba7b-7e800117aa42 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:51.192993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645696b-18ae-4174-ad2e-e38989216319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ce2d233e964fedabaf54c0ad8ef2e8, user_id=427d7030d11b47e8a5661e91eb3e58fb, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:51.195775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645696b-18ae-4174-ad2e-e38989216319 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:51.200362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 808/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:51.201639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984bbb7-14a1-461e-98e6-3abcddffbebf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.201929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984bbb7-14a1-461e-98e6-3abcddffbebf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.202202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984bbb7-14a1-461e-98e6-3abcddffbebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.221968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2984bbb7-14a1-461e-98e6-3abcddffbebf None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:51.222947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2984bbb7-14a1-461e-98e6-3abcddffbebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:51.234409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 809/1636] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:51.286000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984bbb7-14a1-461e-98e6-3abcddffbebf None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:51.289940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 828/1637] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:51 2022] PUT /identity/v3/projects/14ce2d233e964fedabaf54c0ad8ef2e8/users/427d7030d11b47e8a5661e91eb3e58fb/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:51.294187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645696b-18ae-4174-ad2e-e38989216319 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:51.301184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984bbb7-14a1-461e-98e6-3abcddffbebf None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:51.371285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:51.371587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b67a52-1bc3-4f61-974e-e95d02db3207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:51.374572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b67a52-1bc3-4f61-974e-e95d02db3207 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.377315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b67a52-1bc3-4f61-974e-e95d02db3207 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.377315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b67a52-1bc3-4f61-974e-e95d02db3207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.410554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645696b-18ae-4174-ad2e-e38989216319 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:51.416895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300bc1f-ff05-42c0-a66f-42ba612a5b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:51.417782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300bc1f-ff05-42c0-a66f-42ba612a5b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.418452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300bc1f-ff05-42c0-a66f-42ba612a5b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.418933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300bc1f-ff05-42c0-a66f-42ba612a5b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.419961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300bc1f-ff05-42c0-a66f-42ba612a5b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:51.422280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300bc1f-ff05-42c0-a66f-42ba612a5b0a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:51.448285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 829/1638] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:51.453611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300bc1f-ff05-42c0-a66f-42ba612a5b0a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:51.476974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300bc1f-ff05-42c0-a66f-42ba612a5b0a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:51.488639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca000f59-3194-46bb-9d06-b964f0776ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:51.491158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca000f59-3194-46bb-9d06-b964f0776ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.493147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca000f59-3194-46bb-9d06-b964f0776ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.494159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca000f59-3194-46bb-9d06-b964f0776ec0 admin admin] PATH_INFO: `/v3/projects/14ce2d233e964fedabaf54c0ad8ef2e8/users/427d7030d11b47e8a5661e91eb3e58fb/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.500776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca000f59-3194-46bb-9d06-b964f0776ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ce2d233e964fedabaf54c0ad8ef2e8, user_id=427d7030d11b47e8a5661e91eb3e58fb, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:51.508849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca000f59-3194-46bb-9d06-b964f0776ec0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:51.511644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b67a52-1bc3-4f61-974e-e95d02db3207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:51.516949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b67a52-1bc3-4f61-974e-e95d02db3207 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:51.536811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 830/1639] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:51 2022] PUT /identity/v3/projects/14ce2d233e964fedabaf54c0ad8ef2e8/users/427d7030d11b47e8a5661e91eb3e58fb/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:51.542199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7af53-adf7-4b0d-9de0-61c0b5dfe689 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.542604 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7af53-adf7-4b0d-9de0-61c0b5dfe689 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.543564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7af53-adf7-4b0d-9de0-61c0b5dfe689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.547727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 810/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:51 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:22:51.553640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831ac73-c418-41aa-83f4-184978730f5d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.554218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831ac73-c418-41aa-83f4-184978730f5d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.555132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831ac73-c418-41aa-83f4-184978730f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.602230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a831ac73-c418-41aa-83f4-184978730f5d None None] MFA Rules not processed for user `427d7030d11b47e8a5661e91eb3e58fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:51.603914 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a831ac73-c418-41aa-83f4-184978730f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:51.605135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d2c7af53-adf7-4b0d-9de0-61c0b5dfe689 None None] MFA Rules not processed for user `f1306e17dbfe4868a35b8570055d6b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:51.606315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d2c7af53-adf7-4b0d-9de0-61c0b5dfe689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:51.706918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 831/1641] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:51.719400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7af53-adf7-4b0d-9de0-61c0b5dfe689 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:51.724510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 811/1642] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:51.726975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc72a20-e673-4b57-9d65-b9527871a9de None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.727244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc72a20-e673-4b57-9d65-b9527871a9de None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.727529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc72a20-e673-4b57-9d65-b9527871a9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.748970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3dc72a20-e673-4b57-9d65-b9527871a9de None None] MFA Rules not processed for user `f1306e17dbfe4868a35b8570055d6b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:51.750207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3dc72a20-e673-4b57-9d65-b9527871a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:51.770711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 812/1643] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:51.820292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7af53-adf7-4b0d-9de0-61c0b5dfe689 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:51.825902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d16d4-4187-4a3b-afc3-2c0bfb7afc16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:51.828420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d16d4-4187-4a3b-afc3-2c0bfb7afc16 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:51.829153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d16d4-4187-4a3b-afc3-2c0bfb7afc16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:51.829646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d16d4-4187-4a3b-afc3-2c0bfb7afc16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:51.904586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d16d4-4187-4a3b-afc3-2c0bfb7afc16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:51.906308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d16d4-4187-4a3b-afc3-2c0bfb7afc16 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:51.918983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 832/1644] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:51.927622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:51.973544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc72a20-e673-4b57-9d65-b9527871a9de None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:51.995140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc72a20-e673-4b57-9d65-b9527871a9de None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:52.006025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79f0ff-aec7-4fb4-9df4-36dc6d9c75cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:52.008227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79f0ff-aec7-4fb4-9df4-36dc6d9c75cf service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:52.009153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79f0ff-aec7-4fb4-9df4-36dc6d9c75cf service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:52.009448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79f0ff-aec7-4fb4-9df4-36dc6d9c75cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:52.029263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79f0ff-aec7-4fb4-9df4-36dc6d9c75cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:52.031554 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79f0ff-aec7-4fb4-9df4-36dc6d9c75cf service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:52.039280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:52.053547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 813/1645] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:52.208730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d16d4-4187-4a3b-afc3-2c0bfb7afc16 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:52.221147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d16d4-4187-4a3b-afc3-2c0bfb7afc16 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:52.227009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eabce-e493-48ec-a229-045fa0c73deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:52.227828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eabce-e493-48ec-a229-045fa0c73deb service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:52.228118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eabce-e493-48ec-a229-045fa0c73deb service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:52.230158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eabce-e493-48ec-a229-045fa0c73deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:52.242763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5eabce-e493-48ec-a229-045fa0c73deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:52.244247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5eabce-e493-48ec-a229-045fa0c73deb service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:52.270698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 833/1646] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:52.376617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79f0ff-aec7-4fb4-9df4-36dc6d9c75cf service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:52.406795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79f0ff-aec7-4fb4-9df4-36dc6d9c75cf service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:52.418887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f780c-ac9a-4625-8c68-ccb503235163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:52.419560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f780c-ac9a-4625-8c68-ccb503235163 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:52.419847 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f780c-ac9a-4625-8c68-ccb503235163 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:52.420507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f780c-ac9a-4625-8c68-ccb503235163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:52.511381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:52.539286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f780c-ac9a-4625-8c68-ccb503235163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:52.542031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f780c-ac9a-4625-8c68-ccb503235163 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:52.773843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 814/1647] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:52.778027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eabce-e493-48ec-a229-045fa0c73deb service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:52.778027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eabce-e493-48ec-a229-045fa0c73deb service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:52.778027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c463e-777b-4db0-b4ee-523ea61f2f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:52.778027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c463e-777b-4db0-b4ee-523ea61f2f74 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:52.829964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c463e-777b-4db0-b4ee-523ea61f2f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:52.829964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c463e-777b-4db0-b4ee-523ea61f2f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:52.829964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c463e-777b-4db0-b4ee-523ea61f2f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:52.829964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c463e-777b-4db0-b4ee-523ea61f2f74 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:52.829964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 834/1648] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:52.833058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb195dbd-6abd-4bdc-89a2-d6e2ad8a5843 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:52.833058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb195dbd-6abd-4bdc-89a2-d6e2ad8a5843 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:52.833058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb195dbd-6abd-4bdc-89a2-d6e2ad8a5843 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:52.833058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 815/1649] 10.222.0.15 () {54 vars in 912 bytes} [Thu May 26 03:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:22:52.837403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea55eb-0910-45bc-b998-5d6a9f18ec55 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:52.837403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea55eb-0910-45bc-b998-5d6a9f18ec55 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:52.837403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea55eb-0910-45bc-b998-5d6a9f18ec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:52.873305 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dbea55eb-0910-45bc-b998-5d6a9f18ec55 None None] MFA Rules not processed for user `e22fe8105f01400ab6ac3dc14c7aa7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:52.874659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dbea55eb-0910-45bc-b998-5d6a9f18ec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:52.901599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:52.948095 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 835/1650] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:22:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:52.962328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb195dbd-6abd-4bdc-89a2-d6e2ad8a5843 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:52.965538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cb195dbd-6abd-4bdc-89a2-d6e2ad8a5843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:52.981804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb195dbd-6abd-4bdc-89a2-d6e2ad8a5843 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:52.987389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9889e-be59-44ba-bf5a-97b5a00bd579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:52.988736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9889e-be59-44ba-bf5a-97b5a00bd579 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:52.989224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9889e-be59-44ba-bf5a-97b5a00bd579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:52.989667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9889e-be59-44ba-bf5a-97b5a00bd579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:53.002431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9889e-be59-44ba-bf5a-97b5a00bd579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:53.004408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9889e-be59-44ba-bf5a-97b5a00bd579 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:53.013369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 816/1651] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:22:53.379916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea55eb-0910-45bc-b998-5d6a9f18ec55 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:53.520817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea55eb-0910-45bc-b998-5d6a9f18ec55 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:53.526447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:53.530731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:53.531331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:53.532026 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] PATH_INFO: `/v3/users/793667257d4448e1813ed3ac6e9b82c0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:53.545068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=793667257d4448e1813ed3ac6e9b82c0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:53.547336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:53.783245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793667257d4448e1813ed3ac6e9b82c0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:53.784480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793667257d4448e1813ed3ac6e9b82c0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:53.802339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793667257d4448e1813ed3ac6e9b82c0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:53.805127 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793667257d4448e1813ed3ac6e9b82c0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:53.864182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1bc948a-d1bc-4cb3-8aa1-d74470bc5bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793667257d4448e1813ed3ac6e9b82c0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:54.005213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 836/1652] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:22:53 2022] DELETE /identity/v3/users/793667257d4448e1813ed3ac6e9b82c0 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:54.017177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42da61-d488-493b-8a32-30913e05bedd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:54.018083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42da61-d488-493b-8a32-30913e05bedd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:54.018503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42da61-d488-493b-8a32-30913e05bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:54.081144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1a42da61-d488-493b-8a32-30913e05bedd None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:54.084861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a42da61-d488-493b-8a32-30913e05bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:54.172293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a27c70-4da7-4979-aef0-a55e9c2c4c09 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:54.172599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a27c70-4da7-4979-aef0-a55e9c2c4c09 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:54.172886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a27c70-4da7-4979-aef0-a55e9c2c4c09 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:54.175078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 837/1653] 10.222.0.15 () {54 vars in 960 bytes} [Thu May 26 03:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:22:54.180494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f13ae-f3a6-46b7-ba9f-a3c92e5626b2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:54.180972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f13ae-f3a6-46b7-ba9f-a3c92e5626b2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:54.181396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f13ae-f3a6-46b7-ba9f-a3c92e5626b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:54.217461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a70f13ae-f3a6-46b7-ba9f-a3c92e5626b2 None None] MFA Rules not processed for user `257d9a088fa04cd5af48d6e4fb8b2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:54.220031 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a70f13ae-f3a6-46b7-ba9f-a3c92e5626b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:54.234783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 817/1654] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:54.298046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42da61-d488-493b-8a32-30913e05bedd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:54.299770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a42da61-d488-493b-8a32-30913e05bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:54.335904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:54.386282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 838/1655] 10.222.0.15 () {58 vars in 1057 bytes} [Thu May 26 03:22:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:22:54.394303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f13ae-f3a6-46b7-ba9f-a3c92e5626b2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:54.423726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f13ae-f3a6-46b7-ba9f-a3c92e5626b2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:54.440541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:54.441729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:54.443099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:54.443381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:54.450476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:54.457485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42da61-d488-493b-8a32-30913e05bedd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:54.467870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7e042-2943-4d53-9256-986180e85d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:54.469079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e042-2943-4d53-9256-986180e85d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:54.469474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e042-2943-4d53-9256-986180e85d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:54.475073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e042-2943-4d53-9256-986180e85d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:54.504597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:54.511330 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:54.528699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7e042-2943-4d53-9256-986180e85d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:54.540158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7e042-2943-4d53-9256-986180e85d7f service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:54.571585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 839/1656] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:54.590797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 818/1657] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:22:55.576716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:55.576716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:55.611408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab367ff0-075b-4106-bc31-6ebfd9a035a1 service placement] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:55.624183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:55.625272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:55.627598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:55.628431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] PATH_INFO: `/v3/users/1fbe40b7cb2046809bf6a890a12de4d3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:55.633044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbe40b7cb2046809bf6a890a12de4d3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:55.649848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:55.902607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbe40b7cb2046809bf6a890a12de4d3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:55.903664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbe40b7cb2046809bf6a890a12de4d3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:55.917568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbe40b7cb2046809bf6a890a12de4d3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:55.918584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbe40b7cb2046809bf6a890a12de4d3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:55.939695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbe40b7cb2046809bf6a890a12de4d3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:56.034667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 840/1658] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:22:55 2022] DELETE /identity/v3/users/1fbe40b7cb2046809bf6a890a12de4d3 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:56.039584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7ed7a-bb77-441b-944c-7b82e33f8b27 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:56.040087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7ed7a-bb77-441b-944c-7b82e33f8b27 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:56.040156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7ed7a-bb77-441b-944c-7b82e33f8b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:56.098403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-96b7ed7a-bb77-441b-944c-7b82e33f8b27 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:56.107986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-96b7ed7a-bb77-441b-944c-7b82e33f8b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:56.299874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:56.301657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:56.359380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 819/1659] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:56.379467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7ed7a-bb77-441b-944c-7b82e33f8b27 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:56.381180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-96b7ed7a-bb77-441b-944c-7b82e33f8b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:56.411706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:56.498336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6fe0-bda6-4576-acd5-c2073e1eb480 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:56.506323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:56.508759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:56.509250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:56.509744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] PATH_INFO: `/v3/projects/d5eb7896863146b5b36593e7c6e49c1b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:56.515214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5eb7896863146b5b36593e7c6e49c1b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:56.515214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:22:56.515214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: warnings.warn(msg) May 26 03:22:56.515214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: May 26 03:22:56.515214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:56.519729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7ed7a-bb77-441b-944c-7b82e33f8b27 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:56.533995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af261a85-68f0-4ad7-b6db-fcece3984d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:56.538142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af261a85-68f0-4ad7-b6db-fcece3984d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:56.538142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af261a85-68f0-4ad7-b6db-fcece3984d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:56.538142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af261a85-68f0-4ad7-b6db-fcece3984d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:56.555425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af261a85-68f0-4ad7-b6db-fcece3984d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:56.556520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af261a85-68f0-4ad7-b6db-fcece3984d16 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:56.578149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 820/1660] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:22:56.728278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:56.730177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5eb7896863146b5b36593e7c6e49c1b', 'request_id': 'req-2e0eb844-8f57-46bd-9d42-560490a09ea2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:56.828264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5eb7896863146b5b36593e7c6e49c1b', 'request_id': 'req-2e0eb844-8f57-46bd-9d42-560490a09ea2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:56.846113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5eb7896863146b5b36593e7c6e49c1b', 'request_id': 'req-2e0eb844-8f57-46bd-9d42-560490a09ea2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:56.908911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] The token cache is being invalidate because project d5eb7896863146b5b36593e7c6e49c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:22:56.911354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:56.912956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2e0eb844-8f57-46bd-9d42-560490a09ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:56.920637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 841/1661] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:22:56 2022] DELETE /identity/v3/projects/d5eb7896863146b5b36593e7c6e49c1b => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:56.925472 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa840-e930-48a2-b99e-161e9dee785f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:56.925764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa840-e930-48a2-b99e-161e9dee785f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:56.926043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa840-e930-48a2-b99e-161e9dee785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:56.958685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-935aa840-e930-48a2-b99e-161e9dee785f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:56.959924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-935aa840-e930-48a2-b99e-161e9dee785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:57.163303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 821/1662] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:57.171959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a07a6-9f89-4326-bb16-97f27bbc9180 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:57.172250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a07a6-9f89-4326-bb16-97f27bbc9180 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:57.172548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a07a6-9f89-4326-bb16-97f27bbc9180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:57.213532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-957a07a6-9f89-4326-bb16-97f27bbc9180 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:57.214801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-957a07a6-9f89-4326-bb16-97f27bbc9180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:57.257293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 842/1663] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:22:57.261681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa840-e930-48a2-b99e-161e9dee785f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:57.275383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa840-e930-48a2-b99e-161e9dee785f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:57.290927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8d6d1-2238-4328-9de4-7982609ad74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:57.291820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8d6d1-2238-4328-9de4-7982609ad74e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:57.292244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8d6d1-2238-4328-9de4-7982609ad74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:57.292748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8d6d1-2238-4328-9de4-7982609ad74e admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:57.293672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8d6d1-2238-4328-9de4-7982609ad74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:57.294016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8d6d1-2238-4328-9de4-7982609ad74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:57.295638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8d6d1-2238-4328-9de4-7982609ad74e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:57.340162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 822/1664] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:57.340301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a07a6-9f89-4326-bb16-97f27bbc9180 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:57.369002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a07a6-9f89-4326-bb16-97f27bbc9180 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:57.379551 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341f8c8-2544-4c13-942e-12341e50454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:57.380598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f8c8-2544-4c13-942e-12341e50454e admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:57.381027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f8c8-2544-4c13-942e-12341e50454e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:57.381435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f8c8-2544-4c13-942e-12341e50454e admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:57.383029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341f8c8-2544-4c13-942e-12341e50454e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:57.385517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341f8c8-2544-4c13-942e-12341e50454e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:57.526116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8d6d1-2238-4328-9de4-7982609ad74e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:57.541907 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 843/1665] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:57 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:57.549599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8d6d1-2238-4328-9de4-7982609ad74e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:57.752400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d017f-5ae9-4c28-878b-4249d0a2e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:57.754142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d017f-5ae9-4c28-878b-4249d0a2e75a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:57.754440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d017f-5ae9-4c28-878b-4249d0a2e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:57.754725 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d017f-5ae9-4c28-878b-4249d0a2e75a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:57.755489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d017f-5ae9-4c28-878b-4249d0a2e75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:57.758838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d017f-5ae9-4c28-878b-4249d0a2e75a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:57.809315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341f8c8-2544-4c13-942e-12341e50454e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:57.812158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3341f8c8-2544-4c13-942e-12341e50454e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:57.836218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341f8c8-2544-4c13-942e-12341e50454e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:57.851897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:57.853109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:57.853596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:57.856900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] PATH_INFO: `/v3/users/2c76c711d3d84884babe858e0c0a90fc` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:57.862228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c76c711d3d84884babe858e0c0a90fc)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:57.869366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:57.906445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 823/1666] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:57 2022] POST /identity/v3/users => generated 288 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:57.909236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d017f-5ae9-4c28-878b-4249d0a2e75a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:57.960511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d017f-5ae9-4c28-878b-4249d0a2e75a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:57.960511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc302a3-cd64-4ee2-96de-8a98efff69bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:57.960511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc302a3-cd64-4ee2-96de-8a98efff69bd admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:57.960511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc302a3-cd64-4ee2-96de-8a98efff69bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:57.960952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc302a3-cd64-4ee2-96de-8a98efff69bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:57.961151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc302a3-cd64-4ee2-96de-8a98efff69bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:57.963437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc302a3-cd64-4ee2-96de-8a98efff69bd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:57.989430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 824/1667] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:57.994101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc302a3-cd64-4ee2-96de-8a98efff69bd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:58.037834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc302a3-cd64-4ee2-96de-8a98efff69bd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:58.059315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b567-4361-46a6-84d3-bc0731594186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:58.066453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b567-4361-46a6-84d3-bc0731594186 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:58.066453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b567-4361-46a6-84d3-bc0731594186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:58.066453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b567-4361-46a6-84d3-bc0731594186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:58.067211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2b567-4361-46a6-84d3-bc0731594186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:58.071975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2b567-4361-46a6-84d3-bc0731594186 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:58.111621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 825/1668] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:22:58.113789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b567-4361-46a6-84d3-bc0731594186 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:58.122000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-47b2b567-4361-46a6-84d3-bc0731594186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:58.145911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c76c711d3d84884babe858e0c0a90fc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.146789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c76c711d3d84884babe858e0c0a90fc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.153677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b567-4361-46a6-84d3-bc0731594186 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:58.166807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c76c711d3d84884babe858e0c0a90fc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.167706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c76c711d3d84884babe858e0c0a90fc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.168283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:58.170468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:58.170888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:58.171303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] PATH_INFO: `/v3/projects/be73da2c7b294039bc8d99310ff64e3a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:58.178425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be73da2c7b294039bc8d99310ff64e3a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:58.181396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:58.196499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:58.202308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c76c711d3d84884babe858e0c0a90fc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.299059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 844/1669] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:22:57 2022] DELETE /identity/v3/users/2c76c711d3d84884babe858e0c0a90fc => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:58.299994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:58.304959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:58.330525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be73da2c7b294039bc8d99310ff64e3a', 'request_id': 'req-2d730f2a-9109-4bd1-8819-c34abc4985e5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.410782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be73da2c7b294039bc8d99310ff64e3a', 'request_id': 'req-2d730f2a-9109-4bd1-8819-c34abc4985e5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.419216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be73da2c7b294039bc8d99310ff64e3a', 'request_id': 'req-2d730f2a-9109-4bd1-8819-c34abc4985e5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.460114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] The token cache is being invalidate because project be73da2c7b294039bc8d99310ff64e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:22:58.462038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.463212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2d730f2a-9109-4bd1-8819-c34abc4985e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:22:58.472980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 826/1670] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:22:58 2022] DELETE /identity/v3/projects/be73da2c7b294039bc8d99310ff64e3a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:58.474695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561f729-9ea9-4e68-bed9-e0894e4d4a52 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:58.480903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561f729-9ea9-4e68-bed9-e0894e4d4a52 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:58.482071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561f729-9ea9-4e68-bed9-e0894e4d4a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:58.524170 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fddea-ba1a-414f-bfb6-320d69b76583 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:58.547949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6561f729-9ea9-4e68-bed9-e0894e4d4a52 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:58.549464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6561f729-9ea9-4e68-bed9-e0894e4d4a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:58.702083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 827/1671] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:58.707935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316ada-c878-4192-af64-9120e9740879 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:58.708232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316ada-c878-4192-af64-9120e9740879 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:58.708544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316ada-c878-4192-af64-9120e9740879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:58.729765 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821dd65-e213-42ac-b0c5-aafb4521fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:58.731011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821dd65-e213-42ac-b0c5-aafb4521fe09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:58.731430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821dd65-e213-42ac-b0c5-aafb4521fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:58.731841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821dd65-e213-42ac-b0c5-aafb4521fe09 admin admin] PATH_INFO: `/v3/projects/0ce20bd80ca34990a40e22ee8d96b080/users/58d528d148304c26a9a9473695956d5e/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:58.769160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821dd65-e213-42ac-b0c5-aafb4521fe09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce20bd80ca34990a40e22ee8d96b080, user_id=58d528d148304c26a9a9473695956d5e, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:58.782384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821dd65-e213-42ac-b0c5-aafb4521fe09 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:58.800890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c3316ada-c878-4192-af64-9120e9740879 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:58.802124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c3316ada-c878-4192-af64-9120e9740879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:58.839006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 828/1672] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:58.849469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3316ada-c878-4192-af64-9120e9740879 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:58.856587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c3316ada-c878-4192-af64-9120e9740879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:58.878478 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 845/1673] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:22:58 2022] PUT /identity/v3/projects/0ce20bd80ca34990a40e22ee8d96b080/users/58d528d148304c26a9a9473695956d5e/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:22:58.881282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40206d6c-0c5e-4475-bcf8-a82eafcf866d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:58.882617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40206d6c-0c5e-4475-bcf8-a82eafcf866d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:58.885275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40206d6c-0c5e-4475-bcf8-a82eafcf866d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:58.965856 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-40206d6c-0c5e-4475-bcf8-a82eafcf866d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:58.968699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-40206d6c-0c5e-4475-bcf8-a82eafcf866d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:59.007172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3316ada-c878-4192-af64-9120e9740879 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:59.080219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:59.134740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35299b90-0044-41bf-927d-f2e69bc81cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:59.135620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35299b90-0044-41bf-927d-f2e69bc81cfe service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:59.136048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35299b90-0044-41bf-927d-f2e69bc81cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:59.137306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35299b90-0044-41bf-927d-f2e69bc81cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:59.184389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 846/1674] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:59.189798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6416f5-2290-48ba-926e-0d8b947a474f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:59.199740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6416f5-2290-48ba-926e-0d8b947a474f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:59.200028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6416f5-2290-48ba-926e-0d8b947a474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:59.276226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ba6416f5-2290-48ba-926e-0d8b947a474f None None] MFA Rules not processed for user `58d528d148304c26a9a9473695956d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:59.277785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ba6416f5-2290-48ba-926e-0d8b947a474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:59.298251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35299b90-0044-41bf-927d-f2e69bc81cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:59.300085 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35299b90-0044-41bf-927d-f2e69bc81cfe service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:59.328475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 829/1675] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:22:59.329899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1d2dc-9d77-4695-8c84-699c96e13514 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:59.330187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1d2dc-9d77-4695-8c84-699c96e13514 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:59.340872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1d2dc-9d77-4695-8c84-699c96e13514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:59.421975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-31a1d2dc-9d77-4695-8c84-699c96e13514 None None] MFA Rules not processed for user `ce295e83877040b2869cd06409d93c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:59.423407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-31a1d2dc-9d77-4695-8c84-699c96e13514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:59.459365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 847/1676] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:59.460786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6416f5-2290-48ba-926e-0d8b947a474f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:59.479760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6416f5-2290-48ba-926e-0d8b947a474f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:59.486295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:59.487157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:59.487589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:59.488012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:59.496241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:22:59.500040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:22:59.500635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:59.503825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:59.545921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 848/1677] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:22:59.547077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:59.549315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:22:59.577961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147260a8-490f-4520-af99-23c1299c4333 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:59.590776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498af6d-0e86-49f7-87eb-7ecae4c7caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:59.591626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498af6d-0e86-49f7-87eb-7ecae4c7caf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:59.592485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498af6d-0e86-49f7-87eb-7ecae4c7caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:59.594309 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498af6d-0e86-49f7-87eb-7ecae4c7caf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:59.595156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498af6d-0e86-49f7-87eb-7ecae4c7caf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:59.597315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498af6d-0e86-49f7-87eb-7ecae4c7caf8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:59.627330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 830/1678] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:22:59.628671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1d2dc-9d77-4695-8c84-699c96e13514 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:59.651996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1d2dc-9d77-4695-8c84-699c96e13514 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:22:59.663688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af4299-9de5-4328-b78e-d30069ab79e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:22:59.664643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af4299-9de5-4328-b78e-d30069ab79e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:59.665072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af4299-9de5-4328-b78e-d30069ab79e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:59.665490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af4299-9de5-4328-b78e-d30069ab79e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:59.666331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af4299-9de5-4328-b78e-d30069ab79e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:22:59.668621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af4299-9de5-4328-b78e-d30069ab79e4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:22:59.790930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 849/1679] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:59 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:59.792929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ad133-140b-40e1-81c1-da386c057f3d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:22:59.793394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ad133-140b-40e1-81c1-da386c057f3d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:22:59.793957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ad133-140b-40e1-81c1-da386c057f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:22:59.835728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 831/1680] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:22:59 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:22:59.836673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af4299-9de5-4328-b78e-d30069ab79e4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:22:59.871684 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8a9ad133-140b-40e1-81c1-da386c057f3d None None] MFA Rules not processed for user `ce295e83877040b2869cd06409d93c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:22:59.873255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8a9ad133-140b-40e1-81c1-da386c057f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:00.002060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 850/1681] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:22:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:00.006900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ad133-140b-40e1-81c1-da386c057f3d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.044221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af4299-9de5-4328-b78e-d30069ab79e4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:00.058523 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91085b9-883f-4044-a1fe-ff0df60b9cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:00.061192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91085b9-883f-4044-a1fe-ff0df60b9cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.061192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91085b9-883f-4044-a1fe-ff0df60b9cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.061192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91085b9-883f-4044-a1fe-ff0df60b9cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.064232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91085b9-883f-4044-a1fe-ff0df60b9cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:00.066726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91085b9-883f-4044-a1fe-ff0df60b9cf6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:00.181618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ad133-140b-40e1-81c1-da386c057f3d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:00.187078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 832/1682] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:22:59 2022] POST /identity/v3/users => generated 294 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:00.189023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91085b9-883f-4044-a1fe-ff0df60b9cf6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.192752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c108-fbe6-4c2d-ac7e-dd9a6d8785c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:00.193660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c108-fbe6-4c2d-ac7e-dd9a6d8785c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.194053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c108-fbe6-4c2d-ac7e-dd9a6d8785c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.194442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c108-fbe6-4c2d-ac7e-dd9a6d8785c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.195294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917c108-fbe6-4c2d-ac7e-dd9a6d8785c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:00.197384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917c108-fbe6-4c2d-ac7e-dd9a6d8785c7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:00.217819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91085b9-883f-4044-a1fe-ff0df60b9cf6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:00.233614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee8e3e-8af0-4f85-a136-cb40a711d61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:00.236872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee8e3e-8af0-4f85-a136-cb40a711d61d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.237172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee8e3e-8af0-4f85-a136-cb40a711d61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.237462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee8e3e-8af0-4f85-a136-cb40a711d61d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.240814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee8e3e-8af0-4f85-a136-cb40a711d61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:00.245768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee8e3e-8af0-4f85-a136-cb40a711d61d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:00.285574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 833/1683] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:00.288637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee8e3e-8af0-4f85-a136-cb40a711d61d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.298735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-11ee8e3e-8af0-4f85-a136-cb40a711d61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:00.335172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 851/1684] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:00 2022] POST /identity/v3/users => generated 287 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:00.337677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1606-5851-4cce-a29b-fce9a55b8f95 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.339166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1606-5851-4cce-a29b-fce9a55b8f95 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.341402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1606-5851-4cce-a29b-fce9a55b8f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.385188 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ba0e1606-5851-4cce-a29b-fce9a55b8f95 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:00.390679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ba0e1606-5851-4cce-a29b-fce9a55b8f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:00.506257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee8e3e-8af0-4f85-a136-cb40a711d61d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:00.529534 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466135b-acbb-44fc-9496-fa44b2e3d2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:00.530491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466135b-acbb-44fc-9496-fa44b2e3d2e2 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.532545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466135b-acbb-44fc-9496-fa44b2e3d2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.534538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466135b-acbb-44fc-9496-fa44b2e3d2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.557068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 852/1685] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:23:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:00.560146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1606-5851-4cce-a29b-fce9a55b8f95 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.580523 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466135b-acbb-44fc-9496-fa44b2e3d2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:00.582329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466135b-acbb-44fc-9496-fa44b2e3d2e2 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:00.586485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1606-5851-4cce-a29b-fce9a55b8f95 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:00.596964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2738b4-b32f-4da0-924c-2b3542d2b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:00.598136 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2738b4-b32f-4da0-924c-2b3542d2b38a admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.598539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2738b4-b32f-4da0-924c-2b3542d2b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.598885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2738b4-b32f-4da0-924c-2b3542d2b38a admin admin] PATH_INFO: `/v3/projects/0083de7427f84a3ebabbf96ae2abac19/users/1fbda474c4dd4c158b4ea93df20a2d8a/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.601230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 834/1686] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:00.603461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466135b-acbb-44fc-9496-fa44b2e3d2e2 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.619744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2738b4-b32f-4da0-924c-2b3542d2b38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0083de7427f84a3ebabbf96ae2abac19, user_id=1fbda474c4dd4c158b4ea93df20a2d8a, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:00.620604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466135b-acbb-44fc-9496-fa44b2e3d2e2 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:00.623524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2738b4-b32f-4da0-924c-2b3542d2b38a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:00.628484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ee46-8174-4e03-9478-af041cb0760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:00.629599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ee46-8174-4e03-9478-af041cb0760f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.630648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ee46-8174-4e03-9478-af041cb0760f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.632248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ee46-8174-4e03-9478-af041cb0760f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.633827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62ee46-8174-4e03-9478-af041cb0760f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:00.635948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62ee46-8174-4e03-9478-af041cb0760f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:00.655083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 835/1687] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:00.660499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ee46-8174-4e03-9478-af041cb0760f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.680228 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ee46-8174-4e03-9478-af041cb0760f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:00.686807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6f23-4180-4125-94d6-6a341e4d67b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:00.693209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6f23-4180-4125-94d6-6a341e4d67b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.693767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6f23-4180-4125-94d6-6a341e4d67b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.694387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6f23-4180-4125-94d6-6a341e4d67b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.696136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e6f23-4180-4125-94d6-6a341e4d67b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:00.698189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e6f23-4180-4125-94d6-6a341e4d67b1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:00.716656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 836/1688] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:00.720827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6f23-4180-4125-94d6-6a341e4d67b1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.759827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6f23-4180-4125-94d6-6a341e4d67b1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:00.765701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933ca3b-b3ff-4813-b017-94d874ba538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:00.766906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933ca3b-b3ff-4813-b017-94d874ba538d admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.767189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933ca3b-b3ff-4813-b017-94d874ba538d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.767516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933ca3b-b3ff-4813-b017-94d874ba538d admin admin] PATH_INFO: `/v3/projects/fbf4afe6ca94457590a77a60747734c9/users/ee283c02ebc44ab9a852fad0b6881d19/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.787696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 853/1689] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:00 2022] PUT /identity/v3/projects/0083de7427f84a3ebabbf96ae2abac19/users/1fbda474c4dd4c158b4ea93df20a2d8a/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:00.789572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2738b4-b32f-4da0-924c-2b3542d2b38a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.801761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933ca3b-b3ff-4813-b017-94d874ba538d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf4afe6ca94457590a77a60747734c9, user_id=ee283c02ebc44ab9a852fad0b6881d19, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:00.807862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933ca3b-b3ff-4813-b017-94d874ba538d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:00.890449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2738b4-b32f-4da0-924c-2b3542d2b38a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:00.898464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f7c4-c05a-432a-8fcd-3c761d903988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:00.899212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f7c4-c05a-432a-8fcd-3c761d903988 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:00.899499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f7c4-c05a-432a-8fcd-3c761d903988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:00.899944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f7c4-c05a-432a-8fcd-3c761d903988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:00.900927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860f7c4-c05a-432a-8fcd-3c761d903988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:00.904885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860f7c4-c05a-432a-8fcd-3c761d903988 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:00.917849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 854/1690] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:00.919059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f7c4-c05a-432a-8fcd-3c761d903988 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.922601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3860f7c4-c05a-432a-8fcd-3c761d903988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:00.932591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 837/1691] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:00 2022] PUT /identity/v3/projects/fbf4afe6ca94457590a77a60747734c9/users/ee283c02ebc44ab9a852fad0b6881d19/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:00.933765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933ca3b-b3ff-4813-b017-94d874ba538d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:00.957282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f7c4-c05a-432a-8fcd-3c761d903988 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:01.084348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:01.090121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:01.090121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:01.090121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] PATH_INFO: `/v3/projects/5850c4b4df9d4118b43071bb60f3255f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:01.094208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5850c4b4df9d4118b43071bb60f3255f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:01.106375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:01.109284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933ca3b-b3ff-4813-b017-94d874ba538d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:01.122753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c732-490e-44f9-9a9c-36d0d5b46334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:01.124865 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c732-490e-44f9-9a9c-36d0d5b46334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:01.126939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c732-490e-44f9-9a9c-36d0d5b46334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:01.128437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c732-490e-44f9-9a9c-36d0d5b46334 admin admin] PATH_INFO: `/v3/projects/0083de7427f84a3ebabbf96ae2abac19/users/1fbda474c4dd4c158b4ea93df20a2d8a/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:01.135739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97c732-490e-44f9-9a9c-36d0d5b46334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0083de7427f84a3ebabbf96ae2abac19, user_id=1fbda474c4dd4c158b4ea93df20a2d8a, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:01.143770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97c732-490e-44f9-9a9c-36d0d5b46334 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:01.171463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:01.173153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 838/1692] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:00 2022] PUT /identity/v3/projects/0083de7427f84a3ebabbf96ae2abac19/users/1fbda474c4dd4c158b4ea93df20a2d8a/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:01.176185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21543-aa4c-4096-a13d-0c79ca3379d4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:01.176692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21543-aa4c-4096-a13d-0c79ca3379d4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:01.177963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a21543-aa4c-4096-a13d-0c79ca3379d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:01.255591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b1a21543-aa4c-4096-a13d-0c79ca3379d4 None None] MFA Rules not processed for user `ee283c02ebc44ab9a852fad0b6881d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:01.259694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b1a21543-aa4c-4096-a13d-0c79ca3379d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:01.269962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5850c4b4df9d4118b43071bb60f3255f', 'request_id': 'req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:01.347726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5850c4b4df9d4118b43071bb60f3255f', 'request_id': 'req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:01.356254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5850c4b4df9d4118b43071bb60f3255f', 'request_id': 'req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:01.376797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 839/1693] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:01.378971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21543-aa4c-4096-a13d-0c79ca3379d4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:01.382519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b1a21543-aa4c-4096-a13d-0c79ca3379d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:01.385149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] The token cache is being invalidate because project 5850c4b4df9d4118b43071bb60f3255f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:01.385445 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:01.389650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a5bd6bf1-aea2-4cfa-9add-e9fefdd33bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:01.394608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 855/1694] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:00 2022] DELETE /identity/v3/projects/5850c4b4df9d4118b43071bb60f3255f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:01.399451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b801b7-a2c0-47fd-93e8-c38b80b9c317 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:01.399787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b801b7-a2c0-47fd-93e8-c38b80b9c317 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:01.400072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b801b7-a2c0-47fd-93e8-c38b80b9c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:01.419708 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:01.466703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-48b801b7-a2c0-47fd-93e8-c38b80b9c317 None None] MFA Rules not processed for user `1fbda474c4dd4c158b4ea93df20a2d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:01.467962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-48b801b7-a2c0-47fd-93e8-c38b80b9c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:01.482697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a21543-aa4c-4096-a13d-0c79ca3379d4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:01.496181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:01.497211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:01.497711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:01.498178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:01.502671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:01.566697 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 856/1695] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:01.567563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b801b7-a2c0-47fd-93e8-c38b80b9c317 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:01.569653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-48b801b7-a2c0-47fd-93e8-c38b80b9c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:01.594522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:01.596728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:01.626969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 840/1696] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:23:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:23:01.645913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:01.647429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:01.734256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b801b7-a2c0-47fd-93e8-c38b80b9c317 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:01.747168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481192e7-b55c-41a5-897d-76cca9e4f894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:01.748036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481192e7-b55c-41a5-897d-76cca9e4f894 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:01.748482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481192e7-b55c-41a5-897d-76cca9e4f894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:01.748773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481192e7-b55c-41a5-897d-76cca9e4f894 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:01.749484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481192e7-b55c-41a5-897d-76cca9e4f894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:01.751426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481192e7-b55c-41a5-897d-76cca9e4f894 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:01.790664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74b1e-928f-491a-a14d-2c4b9881e54f service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:01.800361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:01.800361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:01.800361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:01.800361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] PATH_INFO: `/v3/users/427d7030d11b47e8a5661e91eb3e58fb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:01.800839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427d7030d11b47e8a5661e91eb3e58fb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:01.800839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 03:23:01.800839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: warnings.warn(msg) May 26 03:23:01.800839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: May 26 03:23:01.802691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:01.926151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 857/1697] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:01 2022] POST /identity/v3/projects => generated 371 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:01.927164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481192e7-b55c-41a5-897d-76cca9e4f894 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:01.937245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-481192e7-b55c-41a5-897d-76cca9e4f894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:02.079995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:02.110837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481192e7-b55c-41a5-897d-76cca9e4f894 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:02.132084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a12dd-e777-45fc-9e9f-a4e77ea41e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:02.133331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a12dd-e777-45fc-9e9f-a4e77ea41e11 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:02.133616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a12dd-e777-45fc-9e9f-a4e77ea41e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:02.133892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a12dd-e777-45fc-9e9f-a4e77ea41e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:02.135348 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427d7030d11b47e8a5661e91eb3e58fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:02.141387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-273a12dd-e777-45fc-9e9f-a4e77ea41e11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:02.253538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427d7030d11b47e8a5661e91eb3e58fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:02.262882 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427d7030d11b47e8a5661e91eb3e58fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:02.342837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427d7030d11b47e8a5661e91eb3e58fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:02.417823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a12dd-e777-45fc-9e9f-a4e77ea41e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:02.419343 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a12dd-e777-45fc-9e9f-a4e77ea41e11 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:02.440280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 858/1698] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:02.441329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a12dd-e777-45fc-9e9f-a4e77ea41e11 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:02.497414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7ce807ee-5e79-4cea-85de-2c4844630f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427d7030d11b47e8a5661e91eb3e58fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:02.500599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:02.509929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 841/1699] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:01 2022] DELETE /identity/v3/users/427d7030d11b47e8a5661e91eb3e58fb => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:02.712449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a12dd-e777-45fc-9e9f-a4e77ea41e11 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:02.918527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a99b90-5fa5-4eda-80e6-55701b83560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:02.919445 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a99b90-5fa5-4eda-80e6-55701b83560f admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:02.919737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a99b90-5fa5-4eda-80e6-55701b83560f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:02.920024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a99b90-5fa5-4eda-80e6-55701b83560f admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:02.920872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a99b90-5fa5-4eda-80e6-55701b83560f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:02.920976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d93e54-8bf2-4d53-a853-265f044e086b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:02.921275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d93e54-8bf2-4d53-a853-265f044e086b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:02.921555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d93e54-8bf2-4d53-a853-265f044e086b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:02.948430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a99b90-5fa5-4eda-80e6-55701b83560f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:02.959979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-20d93e54-8bf2-4d53-a853-265f044e086b None None] MFA Rules not processed for user `ce295e83877040b2869cd06409d93c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:02.964764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-20d93e54-8bf2-4d53-a853-265f044e086b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:03.254384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 842/1700] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:03.254384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fef5-3671-4945-a51e-58a0752b0bab None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:03.254384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fef5-3671-4945-a51e-58a0752b0bab None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:03.254384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fef5-3671-4945-a51e-58a0752b0bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:03.265555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-baa6fef5-3671-4945-a51e-58a0752b0bab None None] MFA Rules not processed for user `e22fe8105f01400ab6ac3dc14c7aa7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:03.266887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-baa6fef5-3671-4945-a51e-58a0752b0bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:03.339868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 859/1701] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:02 2022] POST /identity/v3/users => generated 292 bytes in 899 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:03.360681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a99b90-5fa5-4eda-80e6-55701b83560f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:03.365141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f8a99b90-5fa5-4eda-80e6-55701b83560f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:03.386462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a99b90-5fa5-4eda-80e6-55701b83560f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:03.419354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850c309-217a-4033-bbdf-27f15c51d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:03.420090 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850c309-217a-4033-bbdf-27f15c51d1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:03.420406 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850c309-217a-4033-bbdf-27f15c51d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:03.420689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850c309-217a-4033-bbdf-27f15c51d1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:03.421437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850c309-217a-4033-bbdf-27f15c51d1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:03.423140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850c309-217a-4033-bbdf-27f15c51d1bb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:03.446960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 843/1702] 10.222.0.21 () {58 vars in 1015 bytes} [Thu May 26 03:23:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:03.458199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 860/1703] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:03.462862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6fef5-3671-4945-a51e-58a0752b0bab None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:03.475316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850c309-217a-4033-bbdf-27f15c51d1bb admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:03.489623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8850c309-217a-4033-bbdf-27f15c51d1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:03.502285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6fef5-3671-4945-a51e-58a0752b0bab None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:03.517549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2797a-fbc3-48ca-a625-ecc5657f3b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:03.521819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2797a-fbc3-48ca-a625-ecc5657f3b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:03.522123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2797a-fbc3-48ca-a625-ecc5657f3b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:03.524980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2797a-fbc3-48ca-a625-ecc5657f3b9f admin admin] PATH_INFO: `/v3/projects/1b50c7e16d4d42d0a16cb0193ea4594f/users/a062d1ece240452785e1890a813c821b/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:03.537500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850c309-217a-4033-bbdf-27f15c51d1bb admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:03.548798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb369e-6891-4f3e-8c6c-5ea23d8144b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:03.549473 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb369e-6891-4f3e-8c6c-5ea23d8144b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:03.549759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb369e-6891-4f3e-8c6c-5ea23d8144b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:03.550039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb369e-6891-4f3e-8c6c-5ea23d8144b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:03.579608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb369e-6891-4f3e-8c6c-5ea23d8144b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:03.582197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2797a-fbc3-48ca-a625-ecc5657f3b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b50c7e16d4d42d0a16cb0193ea4594f, user_id=a062d1ece240452785e1890a813c821b, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:03.585461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb369e-6891-4f3e-8c6c-5ea23d8144b8 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:03.593591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2797a-fbc3-48ca-a625-ecc5657f3b9f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:03.607099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 861/1704] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:03.730917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:03.739348 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 844/1705] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:03 2022] PUT /identity/v3/projects/1b50c7e16d4d42d0a16cb0193ea4594f/users/a062d1ece240452785e1890a813c821b/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:03.744857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb369e-6891-4f3e-8c6c-5ea23d8144b8 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:03.770115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb369e-6891-4f3e-8c6c-5ea23d8144b8 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:03.874415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:03.913281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c99985-f499-4ce7-8842-8796d1e8d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:03.915444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c99985-f499-4ce7-8842-8796d1e8d424 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:03.915760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c99985-f499-4ce7-8842-8796d1e8d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:03.916049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c99985-f499-4ce7-8842-8796d1e8d424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:03.918323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c99985-f499-4ce7-8842-8796d1e8d424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:03.923941 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c99985-f499-4ce7-8842-8796d1e8d424 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:03.955857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 862/1706] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:03.956704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2797a-fbc3-48ca-a625-ecc5657f3b9f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:03.976088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2797a-fbc3-48ca-a625-ecc5657f3b9f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:04.024705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bd962-03c9-4ea7-95d6-bceea8ad1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:04.029137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bd962-03c9-4ea7-95d6-bceea8ad1caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:04.030635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bd962-03c9-4ea7-95d6-bceea8ad1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:04.031055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bd962-03c9-4ea7-95d6-bceea8ad1caf admin admin] PATH_INFO: `/v3/projects/1b50c7e16d4d42d0a16cb0193ea4594f/users/a062d1ece240452785e1890a813c821b/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:04.037670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bd962-03c9-4ea7-95d6-bceea8ad1caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b50c7e16d4d42d0a16cb0193ea4594f, user_id=a062d1ece240452785e1890a813c821b, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:04.048124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bd962-03c9-4ea7-95d6-bceea8ad1caf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:04.084344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 845/1707] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:03 2022] PUT /identity/v3/projects/1b50c7e16d4d42d0a16cb0193ea4594f/users/a062d1ece240452785e1890a813c821b/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:04.086297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43e34-8524-4e97-9029-6106c4e8f6d9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:04.086428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43e34-8524-4e97-9029-6106c4e8f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:04.086644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43e34-8524-4e97-9029-6106c4e8f6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:04.207695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-48a43e34-8524-4e97-9029-6106c4e8f6d9 None None] MFA Rules not processed for user `a062d1ece240452785e1890a813c821b`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:04.226975 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-48a43e34-8524-4e97-9029-6106c4e8f6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:04.292237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:04.465954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 863/1708] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:04.471010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bd962-03c9-4ea7-95d6-bceea8ad1caf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:04.472919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ab3bd962-03c9-4ea7-95d6-bceea8ad1caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:04.486991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a43e34-8524-4e97-9029-6106c4e8f6d9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:04.493782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-48a43e34-8524-4e97-9029-6106c4e8f6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:04.690807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a43e34-8524-4e97-9029-6106c4e8f6d9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:04.702896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bd962-03c9-4ea7-95d6-bceea8ad1caf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:04.708959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ccea3-5c80-450b-8e44-857897e358de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:04.709697 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ccea3-5c80-450b-8e44-857897e358de service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:04.709985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ccea3-5c80-450b-8e44-857897e358de service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:04.710268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ccea3-5c80-450b-8e44-857897e358de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:04.724080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:04.727869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:04.728390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:04.728953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] PATH_INFO: `/v3/users/ca42c73a71d2422c9aaefad29e76cfe4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:04.731103 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca42c73a71d2422c9aaefad29e76cfe4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:04.735626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:04.742732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ccea3-5c80-450b-8e44-857897e358de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:04.746149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ccea3-5c80-450b-8e44-857897e358de service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:04.824422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 864/1709] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:04.980764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca42c73a71d2422c9aaefad29e76cfe4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:04.997220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca42c73a71d2422c9aaefad29e76cfe4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:05.001642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca42c73a71d2422c9aaefad29e76cfe4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:05.025441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca42c73a71d2422c9aaefad29e76cfe4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:05.104626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:05.137949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca42c73a71d2422c9aaefad29e76cfe4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:05.148105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 846/1710] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:04 2022] DELETE /identity/v3/users/ca42c73a71d2422c9aaefad29e76cfe4 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:05.154021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11718b3-b637-4406-abb0-39114a6146a1 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:05.154626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11718b3-b637-4406-abb0-39114a6146a1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:05.155123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11718b3-b637-4406-abb0-39114a6146a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:05.207241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e11718b3-b637-4406-abb0-39114a6146a1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:05.211514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e11718b3-b637-4406-abb0-39114a6146a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:05.441964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 865/1711] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:05.514301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:05.516128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:05.598843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11718b3-b637-4406-abb0-39114a6146a1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:05.600358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e11718b3-b637-4406-abb0-39114a6146a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:05.630950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11718b3-b637-4406-abb0-39114a6146a1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:05.663868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:05.664864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:05.665155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:05.665482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] PATH_INFO: `/v3/users/1ab6c2789921428bbc7d35d0a2978aba` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:05.669241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab6c2789921428bbc7d35d0a2978aba)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:05.676485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05276d5-adbd-42d0-9a1d-0ccc2cb3966b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:05.676951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:05.683681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ec67-00be-4ffc-b963-f621be06d93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:05.685917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ec67-00be-4ffc-b963-f621be06d93d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:05.686370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ec67-00be-4ffc-b963-f621be06d93d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:05.687059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ec67-00be-4ffc-b963-f621be06d93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:05.703077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ec67-00be-4ffc-b963-f621be06d93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:05.716924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ec67-00be-4ffc-b963-f621be06d93d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:05.769722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 847/1712] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:05.771247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656a3c9-dc2d-4dd0-b67e-53a9533a6dbf None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:05.771616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656a3c9-dc2d-4dd0-b67e-53a9533a6dbf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:05.771940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656a3c9-dc2d-4dd0-b67e-53a9533a6dbf None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:05.799480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 848/1713] 10.222.0.15 () {54 vars in 912 bytes} [Thu May 26 03:23:05 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:23:05.803670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305b59-ff99-491d-af98-ee5a03b09a74 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:05.803670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305b59-ff99-491d-af98-ee5a03b09a74 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:05.803810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305b59-ff99-491d-af98-ee5a03b09a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:05.820911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:05.894743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-93305b59-ff99-491d-af98-ee5a03b09a74 None None] MFA Rules not processed for user `0f64029bc0664a158b32340b3cbdb311`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:05.897384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-93305b59-ff99-491d-af98-ee5a03b09a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:05.917030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab6c2789921428bbc7d35d0a2978aba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:05.920008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab6c2789921428bbc7d35d0a2978aba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:05.947409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab6c2789921428bbc7d35d0a2978aba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:05.949583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab6c2789921428bbc7d35d0a2978aba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:05.973035 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab6c2789921428bbc7d35d0a2978aba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:06.043111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 849/1714] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:06.049787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66098641-bd79-42b4-bc00-7320efdc2b8a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:06.049787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66098641-bd79-42b4-bc00-7320efdc2b8a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:06.049787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66098641-bd79-42b4-bc00-7320efdc2b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:06.074197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:06.082586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 866/1715] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:05 2022] DELETE /identity/v3/users/1ab6c2789921428bbc7d35d0a2978aba => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:06.085306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:06.085306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:06.098682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-66098641-bd79-42b4-bc00-7320efdc2b8a None None] MFA Rules not processed for user `e22fe8105f01400ab6ac3dc14c7aa7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:06.111115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-66098641-bd79-42b4-bc00-7320efdc2b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:06.316729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 850/1716] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:06.324600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5779c5-01f2-4e37-bef3-8c1ba2c1bc3f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:06.325224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5779c5-01f2-4e37-bef3-8c1ba2c1bc3f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:06.326390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5779c5-01f2-4e37-bef3-8c1ba2c1bc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:06.384281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239257f6-e8c7-4b9b-8f83-1d5af9beb848 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:06.402944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d4c22-235d-4f70-a8cf-9706732bb504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:06.403200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2b5779c5-01f2-4e37-bef3-8c1ba2c1bc3f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:06.404484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d4c22-235d-4f70-a8cf-9706732bb504 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:06.404771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2b5779c5-01f2-4e37-bef3-8c1ba2c1bc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:06.404906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d4c22-235d-4f70-a8cf-9706732bb504 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:06.407601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d4c22-235d-4f70-a8cf-9706732bb504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:06.562609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d4c22-235d-4f70-a8cf-9706732bb504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:06.564597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d4c22-235d-4f70-a8cf-9706732bb504 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:06.584905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 867/1717] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:06.603027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 851/1718] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:06.603027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efaced4-1a5d-4af9-8540-e1817afb43ee None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:06.603027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efaced4-1a5d-4af9-8540-e1817afb43ee None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:06.603027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efaced4-1a5d-4af9-8540-e1817afb43ee None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:06.604207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 852/1719] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:23:06.604985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efaced4-1a5d-4af9-8540-e1817afb43ee None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:06.606992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d4c22-235d-4f70-a8cf-9706732bb504 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:06.610726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f48d4c22-235d-4f70-a8cf-9706732bb504 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:06.614771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5efaced4-1a5d-4af9-8540-e1817afb43ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:06.643695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efaced4-1a5d-4af9-8540-e1817afb43ee None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:06.655480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d4c22-235d-4f70-a8cf-9706732bb504 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:06.663215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:06.664205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:06.664781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:06.665431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] PATH_INFO: `/v3/users/ee283c02ebc44ab9a852fad0b6881d19` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:06.667594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee283c02ebc44ab9a852fad0b6881d19)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:06.672538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:06.674547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1cb63-b202-4094-a5cc-74925b816a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:06.675604 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1cb63-b202-4094-a5cc-74925b816a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:06.679809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1cb63-b202-4094-a5cc-74925b816a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:06.680240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1cb63-b202-4094-a5cc-74925b816a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:06.709624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1cb63-b202-4094-a5cc-74925b816a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:06.712792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1cb63-b202-4094-a5cc-74925b816a10 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:06.737394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 868/1720] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:06.751678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1cb63-b202-4094-a5cc-74925b816a10 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:06.753991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f9a1cb63-b202-4094-a5cc-74925b816a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:06.756486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:06.781669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1cb63-b202-4094-a5cc-74925b816a10 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:06.801183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:06.801183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:06.801183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:06.801183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] PATH_INFO: `/v3/projects/14ce2d233e964fedabaf54c0ad8ef2e8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:06.805296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ce2d233e964fedabaf54c0ad8ef2e8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:06.809418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:06.977538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:06.998317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee283c02ebc44ab9a852fad0b6881d19'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.002424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ce2d233e964fedabaf54c0ad8ef2e8', 'request_id': 'req-ed230fd8-6db4-4256-8146-a1dc5d67135c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.013686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee283c02ebc44ab9a852fad0b6881d19'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.014767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee283c02ebc44ab9a852fad0b6881d19'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.058473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee283c02ebc44ab9a852fad0b6881d19'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.074223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ce2d233e964fedabaf54c0ad8ef2e8', 'request_id': 'req-ed230fd8-6db4-4256-8146-a1dc5d67135c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.084275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ce2d233e964fedabaf54c0ad8ef2e8', 'request_id': 'req-ed230fd8-6db4-4256-8146-a1dc5d67135c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.117529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] The token cache is being invalidate because project 14ce2d233e964fedabaf54c0ad8ef2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:07.117529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.117529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed230fd8-6db4-4256-8146-a1dc5d67135c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.122579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 869/1721] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:06 2022] DELETE /identity/v3/projects/14ce2d233e964fedabaf54c0ad8ef2e8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:07.127988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69ef99-6c42-4b05-a9ea-30910ad7d644 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:07.128860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69ef99-6c42-4b05-a9ea-30910ad7d644 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:07.129953 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69ef99-6c42-4b05-a9ea-30910ad7d644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:07.168892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1e69ef99-6c42-4b05-a9ea-30910ad7d644 None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:07.170760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1e69ef99-6c42-4b05-a9ea-30910ad7d644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:07.296676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee283c02ebc44ab9a852fad0b6881d19'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.308347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 853/1722] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:06 2022] DELETE /identity/v3/users/ee283c02ebc44ab9a852fad0b6881d19 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:07.309579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:07.314430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:07.372704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 870/1723] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:23:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:07.374211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98682fb7-fdb5-40b8-8101-ad62c5cf948d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:07.374572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98682fb7-fdb5-40b8-8101-ad62c5cf948d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:07.389214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98682fb7-fdb5-40b8-8101-ad62c5cf948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:07.433793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441012e-81c3-4884-853f-d5052b380076 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:07.439476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:07.440602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:07.441297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:07.441770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:07.444359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:07.448817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-98682fb7-fdb5-40b8-8101-ad62c5cf948d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:07.450195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-98682fb7-fdb5-40b8-8101-ad62c5cf948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:07.529157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:07.568829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:07.576972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:07.593960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 854/1724] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:07.595089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:07.596945 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:07.599840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 871/1725] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:07.602687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc689e-9ab8-435c-b608-52971884e3ef None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:07.603013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc689e-9ab8-435c-b608-52971884e3ef None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:07.603338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc689e-9ab8-435c-b608-52971884e3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:07.612616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e0e6d-4d2e-4203-a26f-ae186f091d6d service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:07.617864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:07.618928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:07.619359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:07.619782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] PATH_INFO: `/v3/projects/b459e0ce93cc4d1d925ad9e106b5bc67` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:07.621463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b459e0ce93cc4d1d925ad9e106b5bc67)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:07.623918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:07.624036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-02bc689e-9ab8-435c-b608-52971884e3ef None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:07.625127 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-02bc689e-9ab8-435c-b608-52971884e3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:07.642938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 872/1726] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:07.644206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc689e-9ab8-435c-b608-52971884e3ef None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:07.657145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-02bc689e-9ab8-435c-b608-52971884e3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:07.803332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b459e0ce93cc4d1d925ad9e106b5bc67', 'request_id': 'req-b13cd911-10f1-40d1-b219-9ef5970d2363'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.860559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc689e-9ab8-435c-b608-52971884e3ef None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:07.885452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b459e0ce93cc4d1d925ad9e106b5bc67', 'request_id': 'req-b13cd911-10f1-40d1-b219-9ef5970d2363'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.885452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:07.896417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b459e0ce93cc4d1d925ad9e106b5bc67', 'request_id': 'req-b13cd911-10f1-40d1-b219-9ef5970d2363'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.935653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] The token cache is being invalidate because project b459e0ce93cc4d1d925ad9e106b5bc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:07.936088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.941998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:07.947590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 855/1727] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:07 2022] DELETE /identity/v3/projects/b459e0ce93cc4d1d925ad9e106b5bc67 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:07.948697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:07.952152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:08.013309 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b8a6e-2ea2-4b99-b189-0b3d81167a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:08.014267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b8a6e-2ea2-4b99-b189-0b3d81167a98 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:08.019902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b8a6e-2ea2-4b99-b189-0b3d81167a98 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:08.019902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b8a6e-2ea2-4b99-b189-0b3d81167a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:08.019902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-993b8a6e-2ea2-4b99-b189-0b3d81167a98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:08.060174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b8a6e-2ea2-4b99-b189-0b3d81167a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:08.070481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b8a6e-2ea2-4b99-b189-0b3d81167a98 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:08.120811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 873/1728] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:08.123001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287527-e7b4-433c-851c-3e8738d56f7a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:08.126260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287527-e7b4-433c-851c-3e8738d56f7a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:08.126640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287527-e7b4-433c-851c-3e8738d56f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:08.153512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cd911-10f1-40d1-b219-9ef5970d2363 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:08.167676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:08.167915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:08.169004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:08.169301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:08.171802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:08.236056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ab287527-e7b4-433c-851c-3e8738d56f7a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:08.241818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ab287527-e7b4-433c-851c-3e8738d56f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:08.354938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:08.357087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:08.397274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 856/1729] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:08.401164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:08.414608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:08.463374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 874/1730] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:08.466246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287527-e7b4-433c-851c-3e8738d56f7a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:08.468750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ab287527-e7b4-433c-851c-3e8738d56f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:08.502368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287527-e7b4-433c-851c-3e8738d56f7a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:08.520354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:08.521524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:08.521985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:08.522416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] PATH_INFO: `/v3/users/6e463e64c76042daa2f15c5f00fef19b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:08.524383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e463e64c76042daa2f15c5f00fef19b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:08.526950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:08.679754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:08.681970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c03c-0eba-4554-872b-4af14d9b6470 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:08.699253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181f09-329d-4e88-878a-540b7da9022b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:08.699253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181f09-329d-4e88-878a-540b7da9022b service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:08.699253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181f09-329d-4e88-878a-540b7da9022b service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:08.700718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181f09-329d-4e88-878a-540b7da9022b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:08.708095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fc181f09-329d-4e88-878a-540b7da9022b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:08.745011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc181f09-329d-4e88-878a-540b7da9022b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:08.751235 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc181f09-329d-4e88-878a-540b7da9022b service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:08.813654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 857/1731] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:08.816040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181f09-329d-4e88-878a-540b7da9022b service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:08.833039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e463e64c76042daa2f15c5f00fef19b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:08.836974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e463e64c76042daa2f15c5f00fef19b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:08.875707 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181f09-329d-4e88-878a-540b7da9022b service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:08.882962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e463e64c76042daa2f15c5f00fef19b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:08.884336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e463e64c76042daa2f15c5f00fef19b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:08.917251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:08.918125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:08.918471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:08.918867 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:08.919784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:08.920148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:08.921884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:08.958130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e463e64c76042daa2f15c5f00fef19b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:08.982816 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 858/1732] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:08.985806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:08.994878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:09.025424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aef99-d537-4dc4-b81e-65419a16c1e4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:09.042427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 875/1733] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:08 2022] DELETE /identity/v3/users/6e463e64c76042daa2f15c5f00fef19b => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:09.056827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf472599-97d4-4abe-8d93-a14cd3ed29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:09.057937 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf472599-97d4-4abe-8d93-a14cd3ed29a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:09.058344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf472599-97d4-4abe-8d93-a14cd3ed29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:09.058760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf472599-97d4-4abe-8d93-a14cd3ed29a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:09.059578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf472599-97d4-4abe-8d93-a14cd3ed29a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:09.089729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf472599-97d4-4abe-8d93-a14cd3ed29a8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:09.266407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 859/1734] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:08 2022] POST /identity/v3/projects => generated 381 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:09.271311 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:09.423918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6b9b-97f4-4bc7-8410-172e509864f6 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:09.537971 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:09.565352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bde3a-44de-4a67-8eb7-5fb05af1d3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:09.566300 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bde3a-44de-4a67-8eb7-5fb05af1d3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:09.566722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bde3a-44de-4a67-8eb7-5fb05af1d3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:09.567161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bde3a-44de-4a67-8eb7-5fb05af1d3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:09.568295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bde3a-44de-4a67-8eb7-5fb05af1d3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:09.571357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bde3a-44de-4a67-8eb7-5fb05af1d3a1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:09.699014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 876/1735] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:09 2022] POST /identity/v3/users => generated 291 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:09.707755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf472599-97d4-4abe-8d93-a14cd3ed29a8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:09.718885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:09.740813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf472599-97d4-4abe-8d93-a14cd3ed29a8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:09.755807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea490-962b-46a8-8f86-ed0a6ee3460b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:09.756983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea490-962b-46a8-8f86-ed0a6ee3460b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:09.758220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea490-962b-46a8-8f86-ed0a6ee3460b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:09.758770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea490-962b-46a8-8f86-ed0a6ee3460b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:09.759869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea490-962b-46a8-8f86-ed0a6ee3460b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:09.762292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea490-962b-46a8-8f86-ed0a6ee3460b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:09.818455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bde3a-44de-4a67-8eb7-5fb05af1d3a1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:09.822599 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 860/1736] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:09.834968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bde3a-44de-4a67-8eb7-5fb05af1d3a1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:09.857287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e494e36-b168-4422-899f-991ea833818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:09.858715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e494e36-b168-4422-899f-991ea833818e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:09.859281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e494e36-b168-4422-899f-991ea833818e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:09.859800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e494e36-b168-4422-899f-991ea833818e admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:09.860789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e494e36-b168-4422-899f-991ea833818e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:09.863934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e494e36-b168-4422-899f-991ea833818e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:09.883562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 877/1737] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:09.888405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea490-962b-46a8-8f86-ed0a6ee3460b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:09.924833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea490-962b-46a8-8f86-ed0a6ee3460b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:09.945903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a3063-9b70-4dca-a3ae-f2058de5f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:09.948234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a3063-9b70-4dca-a3ae-f2058de5f509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:09.948587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a3063-9b70-4dca-a3ae-f2058de5f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:09.950192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a3063-9b70-4dca-a3ae-f2058de5f509 admin admin] PATH_INFO: `/v3/projects/bd99ac809ac34350b137754e566bfa5f/users/703024cf354c490582e9f00af03589fb/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:10.004790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a3063-9b70-4dca-a3ae-f2058de5f509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd99ac809ac34350b137754e566bfa5f, user_id=703024cf354c490582e9f00af03589fb, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:10.012538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a3063-9b70-4dca-a3ae-f2058de5f509 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:10.128819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 861/1738] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:09 2022] PUT /identity/v3/projects/bd99ac809ac34350b137754e566bfa5f/users/703024cf354c490582e9f00af03589fb/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:10.142558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5af8a-6d7b-4778-9e14-c2f23df08612 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:10.143203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5af8a-6d7b-4778-9e14-c2f23df08612 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:10.143763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5af8a-6d7b-4778-9e14-c2f23df08612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:10.204732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a4a5af8a-6d7b-4778-9e14-c2f23df08612 None None] MFA Rules not processed for user `703024cf354c490582e9f00af03589fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:10.206494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a4a5af8a-6d7b-4778-9e14-c2f23df08612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:10.393725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 878/1739] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:10.399381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a3063-9b70-4dca-a3ae-f2058de5f509 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:10.412173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5af8a-6d7b-4778-9e14-c2f23df08612 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:10.415280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a4a5af8a-6d7b-4778-9e14-c2f23df08612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:10.536076 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:10.587967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5af8a-6d7b-4778-9e14-c2f23df08612 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:10.597180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:10.598764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:10.599375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:10.599868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] PATH_INFO: `/v3/projects/2c37889b5d444642b23ce335624b7e09` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:10.601947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c37889b5d444642b23ce335624b7e09)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:10.605829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:10.619104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a3063-9b70-4dca-a3ae-f2058de5f509 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:10.648461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73a141-9985-4586-a46d-74a14b57ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:10.649151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a141-9985-4586-a46d-74a14b57ac14 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:10.649444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a141-9985-4586-a46d-74a14b57ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:10.649723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a141-9985-4586-a46d-74a14b57ac14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:10.650423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73a141-9985-4586-a46d-74a14b57ac14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:10.652409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73a141-9985-4586-a46d-74a14b57ac14 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:10.823740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c37889b5d444642b23ce335624b7e09', 'request_id': 'req-34c5b742-d9ba-41c7-9427-7d013116e691'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:10.833596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 862/1740] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:10 2022] POST /identity/v3/projects => generated 381 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:10.839755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73a141-9985-4586-a46d-74a14b57ac14 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:10.899218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c37889b5d444642b23ce335624b7e09', 'request_id': 'req-34c5b742-d9ba-41c7-9427-7d013116e691'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:10.905517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c37889b5d444642b23ce335624b7e09', 'request_id': 'req-34c5b742-d9ba-41c7-9427-7d013116e691'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:10.941720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] The token cache is being invalidate because project 2c37889b5d444642b23ce335624b7e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:10.942364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:10.947152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-34c5b742-d9ba-41c7-9427-7d013116e691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:10.949285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 879/1741] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:10 2022] DELETE /identity/v3/projects/2c37889b5d444642b23ce335624b7e09 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:10.953969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dd6a-8567-4c71-be6a-5b879b9ad20c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:10.954256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dd6a-8567-4c71-be6a-5b879b9ad20c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:10.954536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dd6a-8567-4c71-be6a-5b879b9ad20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:10.998574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73a141-9985-4586-a46d-74a14b57ac14 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:11.017803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6435b-150f-4257-ba60-16dd68e9f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:11.018928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6435b-150f-4257-ba60-16dd68e9f289 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:11.019915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6435b-150f-4257-ba60-16dd68e9f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:11.021163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6435b-150f-4257-ba60-16dd68e9f289 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:11.022132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6435b-150f-4257-ba60-16dd68e9f289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:11.025380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6435b-150f-4257-ba60-16dd68e9f289 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:11.038447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0891dd6a-8567-4c71-be6a-5b879b9ad20c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:11.040207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0891dd6a-8567-4c71-be6a-5b879b9ad20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:11.065615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 880/1742] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:11.066426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891dd6a-8567-4c71-be6a-5b879b9ad20c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:11.073469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0891dd6a-8567-4c71-be6a-5b879b9ad20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:11.096728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891dd6a-8567-4c71-be6a-5b879b9ad20c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:11.134442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:11.135724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:11.136009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:11.136304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] PATH_INFO: `/v3/projects/fbf4afe6ca94457590a77a60747734c9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:11.139987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf4afe6ca94457590a77a60747734c9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:11.142109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:11.210892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 863/1743] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:10 2022] POST /identity/v3/users => generated 297 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:11.212654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0739-24e7-4a98-b77e-db64543778b9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:11.213017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0739-24e7-4a98-b77e-db64543778b9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:11.213373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0739-24e7-4a98-b77e-db64543778b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:11.250172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-780b0739-24e7-4a98-b77e-db64543778b9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:11.251686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-780b0739-24e7-4a98-b77e-db64543778b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:11.296049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 864/1744] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:11.297186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b0739-24e7-4a98-b77e-db64543778b9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:11.304020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-780b0739-24e7-4a98-b77e-db64543778b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:11.323661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b0739-24e7-4a98-b77e-db64543778b9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:11.331977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73779f7-379f-4975-8217-734190fbe111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:11.333967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73779f7-379f-4975-8217-734190fbe111 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:11.334875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73779f7-379f-4975-8217-734190fbe111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:11.335386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73779f7-379f-4975-8217-734190fbe111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:11.337020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73779f7-379f-4975-8217-734190fbe111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:11.339310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73779f7-379f-4975-8217-734190fbe111 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:11.356078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 865/1745] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:11.357223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73779f7-379f-4975-8217-734190fbe111 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:11.384807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73779f7-379f-4975-8217-734190fbe111 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:11.408617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf4afe6ca94457590a77a60747734c9', 'request_id': 'req-1af29f99-673c-456c-8c99-195589140df5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:11.467824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:11.502435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf4afe6ca94457590a77a60747734c9', 'request_id': 'req-1af29f99-673c-456c-8c99-195589140df5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:11.510201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf4afe6ca94457590a77a60747734c9', 'request_id': 'req-1af29f99-673c-456c-8c99-195589140df5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:11.533522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] The token cache is being invalidate because project fbf4afe6ca94457590a77a60747734c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:11.533941 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:11.534788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:11.537874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 881/1746] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:11 2022] DELETE /identity/v3/projects/fbf4afe6ca94457590a77a60747734c9 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:11.539636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:11.544156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:11.557233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:11.557935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:11.558298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:11.558491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:11.559232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:11.559539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:11.564171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:11.601198 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 866/1747] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:11.602593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:11.606252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:11.645902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e7690-3c17-4fa0-a96f-ff4ea44269be admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:11.659999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:11.661403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:11.661887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:11.662311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] PATH_INFO: `/v3/users/a062d1ece240452785e1890a813c821b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:11.666231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a062d1ece240452785e1890a813c821b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:11.676957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:11.711238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29f99-673c-456c-8c99-195589140df5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:11.723012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf155e7a-32e3-496b-b8fb-3c4ec07a14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:11.726852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155e7a-32e3-496b-b8fb-3c4ec07a14f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:11.729319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155e7a-32e3-496b-b8fb-3c4ec07a14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:11.729790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155e7a-32e3-496b-b8fb-3c4ec07a14f8 admin admin] PATH_INFO: `/v3/projects/5960513cc9644a9ebf79ccf44b5a767b/users/ea6abf3c56a64d97af3cd6cb0abdbb5e/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:11.767919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf155e7a-32e3-496b-b8fb-3c4ec07a14f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5960513cc9644a9ebf79ccf44b5a767b, user_id=ea6abf3c56a64d97af3cd6cb0abdbb5e, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:11.771916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf155e7a-32e3-496b-b8fb-3c4ec07a14f8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:11.869664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 882/1748] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:11 2022] PUT /identity/v3/projects/5960513cc9644a9ebf79ccf44b5a767b/users/ea6abf3c56a64d97af3cd6cb0abdbb5e/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:11.869664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf155e7a-32e3-496b-b8fb-3c4ec07a14f8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:11.874703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:11.876768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bf155e7a-32e3-496b-b8fb-3c4ec07a14f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:11.951407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a062d1ece240452785e1890a813c821b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:11.982224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a062d1ece240452785e1890a813c821b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:11.985338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a062d1ece240452785e1890a813c821b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:12.065049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a062d1ece240452785e1890a813c821b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:12.067892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf155e7a-32e3-496b-b8fb-3c4ec07a14f8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:12.114389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62902102-5023-4cf2-ad0b-4ab2ed69432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:12.119790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62902102-5023-4cf2-ad0b-4ab2ed69432f admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:12.119790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62902102-5023-4cf2-ad0b-4ab2ed69432f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:12.119790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62902102-5023-4cf2-ad0b-4ab2ed69432f admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:12.119790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62902102-5023-4cf2-ad0b-4ab2ed69432f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:12.144822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62902102-5023-4cf2-ad0b-4ab2ed69432f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:12.212028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a062d1ece240452785e1890a813c821b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:12.225205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 867/1749] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:11 2022] DELETE /identity/v3/users/a062d1ece240452785e1890a813c821b => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:12.229147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:12.232633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:12.348276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 883/1750] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:11 2022] POST /identity/v3/projects => generated 355 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:12.353116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62902102-5023-4cf2-ad0b-4ab2ed69432f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:12.360873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-62902102-5023-4cf2-ad0b-4ab2ed69432f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:12.581283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cef29-ec39-4472-8caa-71aa57be4a19 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:12.594367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7812bc-6002-4297-aedc-7ab50ee6bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:12.594574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62902102-5023-4cf2-ad0b-4ab2ed69432f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:12.595097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7812bc-6002-4297-aedc-7ab50ee6bc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:12.595385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7812bc-6002-4297-aedc-7ab50ee6bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:12.595661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7812bc-6002-4297-aedc-7ab50ee6bc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:12.596531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7812bc-6002-4297-aedc-7ab50ee6bc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:12.598380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7812bc-6002-4297-aedc-7ab50ee6bc57 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:12.612727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5e851-eea7-4042-95e3-876b177631b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:12.613479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5e851-eea7-4042-95e3-876b177631b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:12.613768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5e851-eea7-4042-95e3-876b177631b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:12.614101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5e851-eea7-4042-95e3-876b177631b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:12.615019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5e851-eea7-4042-95e3-876b177631b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:12.629326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 868/1751] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:12.630359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7812bc-6002-4297-aedc-7ab50ee6bc57 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:12.632145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5e851-eea7-4042-95e3-876b177631b0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:12.662299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7812bc-6002-4297-aedc-7ab50ee6bc57 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:12.677528 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2539-3ad0-467a-9c5c-4bb07ccfde4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:12.678944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2539-3ad0-467a-9c5c-4bb07ccfde4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:12.679263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2539-3ad0-467a-9c5c-4bb07ccfde4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:12.679637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2539-3ad0-467a-9c5c-4bb07ccfde4a admin admin] PATH_INFO: `/v3/projects/5960513cc9644a9ebf79ccf44b5a767b/users/ea6abf3c56a64d97af3cd6cb0abdbb5e/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:12.683195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2539-3ad0-467a-9c5c-4bb07ccfde4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5960513cc9644a9ebf79ccf44b5a767b, user_id=ea6abf3c56a64d97af3cd6cb0abdbb5e, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:12.696713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2539-3ad0-467a-9c5c-4bb07ccfde4a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:12.717817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 869/1752] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:12 2022] PUT /identity/v3/projects/5960513cc9644a9ebf79ccf44b5a767b/users/ea6abf3c56a64d97af3cd6cb0abdbb5e/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:12.732505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f696b15-0894-42ea-b4bb-027ab2b8fb38 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:12.732800 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f696b15-0894-42ea-b4bb-027ab2b8fb38 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:12.733081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f696b15-0894-42ea-b4bb-027ab2b8fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:12.748809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 884/1753] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:12 2022] POST /identity/v3/users => generated 278 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:12.750122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5e851-eea7-4042-95e3-876b177631b0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:12.784539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5e851-eea7-4042-95e3-876b177631b0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:12.806359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:12.810175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5f696b15-0894-42ea-b4bb-027ab2b8fb38 None None] MFA Rules not processed for user `ea6abf3c56a64d97af3cd6cb0abdbb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:12.811808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f696b15-0894-42ea-b4bb-027ab2b8fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:12.834027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:12.883586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c343ea5-d2d1-49af-a7b5-b06e010aa62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:12.884286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c343ea5-d2d1-49af-a7b5-b06e010aa62c admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:12.884660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c343ea5-d2d1-49af-a7b5-b06e010aa62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:12.885068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c343ea5-d2d1-49af-a7b5-b06e010aa62c admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:12.885878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c343ea5-d2d1-49af-a7b5-b06e010aa62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:12.887789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c343ea5-d2d1-49af-a7b5-b06e010aa62c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:12.900510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 885/1754] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:12.906767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c343ea5-d2d1-49af-a7b5-b06e010aa62c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:12.917903 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c343ea5-d2d1-49af-a7b5-b06e010aa62c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:12.926799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba7930-87bf-484e-aa54-39f0c20e5467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:12.927594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba7930-87bf-484e-aa54-39f0c20e5467 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:12.927958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba7930-87bf-484e-aa54-39f0c20e5467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:12.928338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba7930-87bf-484e-aa54-39f0c20e5467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:12.929147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba7930-87bf-484e-aa54-39f0c20e5467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:12.931570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba7930-87bf-484e-aa54-39f0c20e5467 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:12.944243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 886/1755] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:12.948822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba7930-87bf-484e-aa54-39f0c20e5467 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:12.964515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba7930-87bf-484e-aa54-39f0c20e5467 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:12.972486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731d3ed-b0fe-4203-a0fc-7a96bcdab98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:12.973544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731d3ed-b0fe-4203-a0fc-7a96bcdab98f admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:12.973837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731d3ed-b0fe-4203-a0fc-7a96bcdab98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:12.974117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731d3ed-b0fe-4203-a0fc-7a96bcdab98f admin admin] PATH_INFO: `/v3/projects/a27f5c79018b468c9746e06e330ac2ef/users/f2f47d9b428540aaa68b3691a8af6006/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:12.998346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731d3ed-b0fe-4203-a0fc-7a96bcdab98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27f5c79018b468c9746e06e330ac2ef, user_id=f2f47d9b428540aaa68b3691a8af6006, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:13.001234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731d3ed-b0fe-4203-a0fc-7a96bcdab98f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:13.008699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 870/1756] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:13.015241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f696b15-0894-42ea-b4bb-027ab2b8fb38 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:13.020054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f696b15-0894-42ea-b4bb-027ab2b8fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:13.110821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 887/1757] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:12 2022] PUT /identity/v3/projects/a27f5c79018b468c9746e06e330ac2ef/users/f2f47d9b428540aaa68b3691a8af6006/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:13.126688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041b990-7452-4f1d-9ad5-d674fb352684 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:13.127137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041b990-7452-4f1d-9ad5-d674fb352684 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:13.127261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041b990-7452-4f1d-9ad5-d674fb352684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:13.153327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f696b15-0894-42ea-b4bb-027ab2b8fb38 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:13.203215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c041b990-7452-4f1d-9ad5-d674fb352684 None None] MFA Rules not processed for user `f2f47d9b428540aaa68b3691a8af6006`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:13.205378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c041b990-7452-4f1d-9ad5-d674fb352684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:13.274297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816b492-4015-4131-b19c-ce46ae477a68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:13.276008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816b492-4015-4131-b19c-ce46ae477a68 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:13.276790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816b492-4015-4131-b19c-ce46ae477a68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:13.277451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816b492-4015-4131-b19c-ce46ae477a68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:13.370043 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 888/1758] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:13 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:13.372994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041b990-7452-4f1d-9ad5-d674fb352684 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:13.381725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c041b990-7452-4f1d-9ad5-d674fb352684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:13.436080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816b492-4015-4131-b19c-ce46ae477a68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:13.439813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816b492-4015-4131-b19c-ce46ae477a68 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:13.469833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 871/1759] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:13.477434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816b492-4015-4131-b19c-ce46ae477a68 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:13.524712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041b990-7452-4f1d-9ad5-d674fb352684 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:13.545538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:13.549724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:13.550000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:13.550303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] PATH_INFO: `/v3/projects/83f53df5ce054561b6c93df8bdd0fbc8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:13.555467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f53df5ce054561b6c93df8bdd0fbc8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:13.579226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:13.579226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:13.705605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816b492-4015-4131-b19c-ce46ae477a68 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:13.722267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9fb8a-ba6b-494b-9dff-2570a4171ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:13.722950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9fb8a-ba6b-494b-9dff-2570a4171ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:13.723233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9fb8a-ba6b-494b-9dff-2570a4171ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:13.723507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9fb8a-ba6b-494b-9dff-2570a4171ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:13.724394 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9fb8a-ba6b-494b-9dff-2570a4171ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:13.731061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9fb8a-ba6b-494b-9dff-2570a4171ef4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:13.839212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f53df5ce054561b6c93df8bdd0fbc8', 'request_id': 'req-f6527bfc-a3b4-424a-a628-bc70817ff458'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:13.847433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 872/1760] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:13 2022] POST /identity/v3/projects => generated 355 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:13.849241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00467-2b71-4ed1-91a9-61a3a9b91c4d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:13.849754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00467-2b71-4ed1-91a9-61a3a9b91c4d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:13.850167 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00467-2b71-4ed1-91a9-61a3a9b91c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:13.877258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-aaf00467-2b71-4ed1-91a9-61a3a9b91c4d None None] MFA Rules not processed for user `0f64029bc0664a158b32340b3cbdb311`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:13.878716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-aaf00467-2b71-4ed1-91a9-61a3a9b91c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:13.930900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f53df5ce054561b6c93df8bdd0fbc8', 'request_id': 'req-f6527bfc-a3b4-424a-a628-bc70817ff458'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:13.942268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f53df5ce054561b6c93df8bdd0fbc8', 'request_id': 'req-f6527bfc-a3b4-424a-a628-bc70817ff458'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:13.943247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:13.965860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] The token cache is being invalidate because project 83f53df5ce054561b6c93df8bdd0fbc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:13.966159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:13.968142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:13.972341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 889/1761] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:13 2022] DELETE /identity/v3/projects/83f53df5ce054561b6c93df8bdd0fbc8 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:13.977194 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:13.978525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 873/1762] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:13.980147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf159e-f717-4307-913c-27db9f82ee2f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:13.980474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf159e-f717-4307-913c-27db9f82ee2f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:13.980757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf159e-f717-4307-913c-27db9f82ee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:13.984266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:14.025487 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-dcbf159e-f717-4307-913c-27db9f82ee2f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:14.026715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dcbf159e-f717-4307-913c-27db9f82ee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:14.130746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6527bfc-a3b4-424a-a628-bc70817ff458 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:14.194516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 874/1763] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:14.196232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf159e-f717-4307-913c-27db9f82ee2f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:14.197681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dcbf159e-f717-4307-913c-27db9f82ee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:14.215469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf159e-f717-4307-913c-27db9f82ee2f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:14.221649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:14.222529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:14.222918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:14.223709 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] PATH_INFO: `/v3/projects/1b50c7e16d4d42d0a16cb0193ea4594f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:14.225912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b50c7e16d4d42d0a16cb0193ea4594f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:14.229790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:14.263164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f8854-96d5-4026-a7b2-ced1b2e95cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:14.264150 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f8854-96d5-4026-a7b2-ced1b2e95cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:14.264642 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f8854-96d5-4026-a7b2-ced1b2e95cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:14.264993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f8854-96d5-4026-a7b2-ced1b2e95cdd admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:14.265861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f8854-96d5-4026-a7b2-ced1b2e95cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:14.267959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f8854-96d5-4026-a7b2-ced1b2e95cdd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:14.401246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 890/1764] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:13 2022] POST /identity/v3/users => generated 284 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:14.401246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7172e35-8424-483b-999b-826ac654f11c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:14.401246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7172e35-8424-483b-999b-826ac654f11c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:14.404329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7172e35-8424-483b-999b-826ac654f11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:14.423469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:14.436250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b50c7e16d4d42d0a16cb0193ea4594f', 'request_id': 'req-1e3014de-0a98-4459-9d79-4af17c10f94e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:14.469026 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c7172e35-8424-483b-999b-826ac654f11c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:14.471283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c7172e35-8424-483b-999b-826ac654f11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:14.531946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:14.535917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b50c7e16d4d42d0a16cb0193ea4594f', 'request_id': 'req-1e3014de-0a98-4459-9d79-4af17c10f94e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:14.546745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b50c7e16d4d42d0a16cb0193ea4594f', 'request_id': 'req-1e3014de-0a98-4459-9d79-4af17c10f94e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:14.580847 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] The token cache is being invalidate because project 1b50c7e16d4d42d0a16cb0193ea4594f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:14.581159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:14.583069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:14.590031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 875/1765] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:14 2022] DELETE /identity/v3/projects/1b50c7e16d4d42d0a16cb0193ea4594f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:14.590031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:14.590031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:14.599740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 891/1766] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:14.602160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee88e8-dc99-4a2c-a68b-f1fc9a1e1a6f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:14.602664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee88e8-dc99-4a2c-a68b-f1fc9a1e1a6f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:14.603241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee88e8-dc99-4a2c-a68b-f1fc9a1e1a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:14.626994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-99ee88e8-dc99-4a2c-a68b-f1fc9a1e1a6f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:14.629583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-99ee88e8-dc99-4a2c-a68b-f1fc9a1e1a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:14.642609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 892/1767] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:14.646550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee88e8-dc99-4a2c-a68b-f1fc9a1e1a6f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:14.662489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee88e8-dc99-4a2c-a68b-f1fc9a1e1a6f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:14.681857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19a028-81ab-4e57-847d-8fdecd363574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:14.682548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19a028-81ab-4e57-847d-8fdecd363574 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:14.682832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19a028-81ab-4e57-847d-8fdecd363574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:14.683105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19a028-81ab-4e57-847d-8fdecd363574 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:14.684026 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19a028-81ab-4e57-847d-8fdecd363574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:14.684244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19a028-81ab-4e57-847d-8fdecd363574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:14.685783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19a028-81ab-4e57-847d-8fdecd363574 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:14.714615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 893/1768] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:14.718872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afbcec-de5c-4680-8fc6-0b25a6da07d9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:14.733444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afbcec-de5c-4680-8fc6-0b25a6da07d9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:14.733444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afbcec-de5c-4680-8fc6-0b25a6da07d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:14.738149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3014de-0a98-4459-9d79-4af17c10f94e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:14.745848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa75ce1-19e3-4b94-bee0-da793800bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:14.746916 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa75ce1-19e3-4b94-bee0-da793800bc6f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:14.747527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa75ce1-19e3-4b94-bee0-da793800bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:14.748100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa75ce1-19e3-4b94-bee0-da793800bc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:14.749301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa75ce1-19e3-4b94-bee0-da793800bc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:14.751285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa75ce1-19e3-4b94-bee0-da793800bc6f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:14.773102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-94afbcec-de5c-4680-8fc6-0b25a6da07d9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:14.776930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 876/1769] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:14.777104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-94afbcec-de5c-4680-8fc6-0b25a6da07d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:14.778218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa75ce1-19e3-4b94-bee0-da793800bc6f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:14.801239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 894/1770] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:14.802124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afbcec-de5c-4680-8fc6-0b25a6da07d9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:14.810150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa75ce1-19e3-4b94-bee0-da793800bc6f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:14.818565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56f229-7a97-4828-a549-9048bbbe602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:14.819811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56f229-7a97-4828-a549-9048bbbe602b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:14.820492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56f229-7a97-4828-a549-9048bbbe602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:14.821176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56f229-7a97-4828-a549-9048bbbe602b admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:14.822279 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56f229-7a97-4828-a549-9048bbbe602b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:14.826054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56f229-7a97-4828-a549-9048bbbe602b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:14.827693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afbcec-de5c-4680-8fc6-0b25a6da07d9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:14.849058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92e2d6-a8bb-4acc-9c9e-2ac09b3d7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:14.849927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92e2d6-a8bb-4acc-9c9e-2ac09b3d7d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:14.850219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92e2d6-a8bb-4acc-9c9e-2ac09b3d7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:14.850506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92e2d6-a8bb-4acc-9c9e-2ac09b3d7d4c admin admin] PATH_INFO: `/v3/projects/4c48f92d3085464a955a83dbfe08b0e9/users/1c6c226d4ee44ea587725e27fd642ccd/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:14.893802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92e2d6-a8bb-4acc-9c9e-2ac09b3d7d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c48f92d3085464a955a83dbfe08b0e9, user_id=1c6c226d4ee44ea587725e27fd642ccd, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:14.905505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92e2d6-a8bb-4acc-9c9e-2ac09b3d7d4c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:14.988135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 877/1771] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:14 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:14.989515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56f229-7a97-4828-a549-9048bbbe602b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.013115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 895/1772] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:14 2022] PUT /identity/v3/projects/4c48f92d3085464a955a83dbfe08b0e9/users/1c6c226d4ee44ea587725e27fd642ccd/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:15.014295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92e2d6-a8bb-4acc-9c9e-2ac09b3d7d4c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.018537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cf92e2d6-a8bb-4acc-9c9e-2ac09b3d7d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:15.112790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56f229-7a97-4828-a549-9048bbbe602b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:15.220400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92e2d6-a8bb-4acc-9c9e-2ac09b3d7d4c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:15.229756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357530f9-671f-4d75-b353-5fc7386cb7ac tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea6abf3c56a64d97af3cd6cb0abdbb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5960513cc9644a9ebf79ccf44b5a767b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:15.231577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357530f9-671f-4d75-b353-5fc7386cb7ac tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:15.232352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357530f9-671f-4d75-b353-5fc7386cb7ac tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:15.233158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357530f9-671f-4d75-b353-5fc7386cb7ac tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:15.234697 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357530f9-671f-4d75-b353-5fc7386cb7ac tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:15.235577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357530f9-671f-4d75-b353-5fc7386cb7ac tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:15.240097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357530f9-671f-4d75-b353-5fc7386cb7ac tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:15.262600 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 896/1773] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:15.263771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357530f9-671f-4d75-b353-5fc7386cb7ac tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.321111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1203-df10-4d97-b10d-3535e189c378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:15.322199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1203-df10-4d97-b10d-3535e189c378 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:15.322690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1203-df10-4d97-b10d-3535e189c378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:15.323166 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1203-df10-4d97-b10d-3535e189c378 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:15.324572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1203-df10-4d97-b10d-3535e189c378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:15.325086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1203-df10-4d97-b10d-3535e189c378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:15.330790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1203-df10-4d97-b10d-3535e189c378 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:15.362299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 878/1774] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:15.363405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1203-df10-4d97-b10d-3535e189c378 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.380273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1203-df10-4d97-b10d-3535e189c378 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:15.386427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18e1b0-9840-4cb5-9e2d-315e997ce94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:15.387760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18e1b0-9840-4cb5-9e2d-315e997ce94f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:15.387760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18e1b0-9840-4cb5-9e2d-315e997ce94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:15.387760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18e1b0-9840-4cb5-9e2d-315e997ce94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:15.388563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18e1b0-9840-4cb5-9e2d-315e997ce94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:15.390341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18e1b0-9840-4cb5-9e2d-315e997ce94f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:15.395646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357530f9-671f-4d75-b353-5fc7386cb7ac tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:15.403063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 879/1775] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:15.405762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18e1b0-9840-4cb5-9e2d-315e997ce94f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.408442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fa6a3-6dc1-4fea-8972-a5089d5a47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:15.409142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fa6a3-6dc1-4fea-8972-a5089d5a47aa admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:15.409436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fa6a3-6dc1-4fea-8972-a5089d5a47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:15.409710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fa6a3-6dc1-4fea-8972-a5089d5a47aa admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:15.410486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fa6a3-6dc1-4fea-8972-a5089d5a47aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:15.413088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fa6a3-6dc1-4fea-8972-a5089d5a47aa admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:15.416481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18e1b0-9840-4cb5-9e2d-315e997ce94f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:15.422580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbb0be-e7db-47c1-be8e-f85de1c6ec5f tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea6abf3c56a64d97af3cd6cb0abdbb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5960513cc9644a9ebf79ccf44b5a767b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:15.423364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbb0be-e7db-47c1-be8e-f85de1c6ec5f tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:15.423737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbb0be-e7db-47c1-be8e-f85de1c6ec5f tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:15.424088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbb0be-e7db-47c1-be8e-f85de1c6ec5f tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:15.424954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbb0be-e7db-47c1-be8e-f85de1c6ec5f tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:15.427800 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbb0be-e7db-47c1-be8e-f85de1c6ec5f tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:15.475393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 897/1776] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:15 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:15.477194 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fa6a3-6dc1-4fea-8972-a5089d5a47aa admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.490232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fa6a3-6dc1-4fea-8972-a5089d5a47aa admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:15.497474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a3bc3-7034-4fc5-bccd-7f4bb3aacf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:15.498516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a3bc3-7034-4fc5-bccd-7f4bb3aacf0b admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:15.498855 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a3bc3-7034-4fc5-bccd-7f4bb3aacf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:15.499417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a3bc3-7034-4fc5-bccd-7f4bb3aacf0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:15.500245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a3bc3-7034-4fc5-bccd-7f4bb3aacf0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:15.502357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a3bc3-7034-4fc5-bccd-7f4bb3aacf0b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:15.534979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 880/1777] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:15 2022] POST /identity/v3/projects => generated 354 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:15.541813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbb0be-e7db-47c1-be8e-f85de1c6ec5f tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.644967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 898/1778] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:15 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:15.644967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a3bc3-7034-4fc5-bccd-7f4bb3aacf0b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.717673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbb0be-e7db-47c1-be8e-f85de1c6ec5f tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:15.809474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a3bc3-7034-4fc5-bccd-7f4bb3aacf0b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:15.817251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45750275-f86d-4ffc-89fa-c8a40fe11980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:15.818023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45750275-f86d-4ffc-89fa-c8a40fe11980 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:15.818455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45750275-f86d-4ffc-89fa-c8a40fe11980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:15.818786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45750275-f86d-4ffc-89fa-c8a40fe11980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:15.819664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45750275-f86d-4ffc-89fa-c8a40fe11980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:15.822210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45750275-f86d-4ffc-89fa-c8a40fe11980 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:15.849789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 899/1779] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:15.852598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:15.853287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45750275-f86d-4ffc-89fa-c8a40fe11980 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.869671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1752954-b7d7-48cd-bb6d-29045e99245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:15.870744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1752954-b7d7-48cd-bb6d-29045e99245c admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:15.871030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1752954-b7d7-48cd-bb6d-29045e99245c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:15.871649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1752954-b7d7-48cd-bb6d-29045e99245c admin admin] PATH_INFO: `/v3/projects/4c48f92d3085464a955a83dbfe08b0e9/users/1c6c226d4ee44ea587725e27fd642ccd/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:15.877824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1752954-b7d7-48cd-bb6d-29045e99245c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c48f92d3085464a955a83dbfe08b0e9, user_id=1c6c226d4ee44ea587725e27fd642ccd, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:15.880542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1752954-b7d7-48cd-bb6d-29045e99245c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:15.902092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 881/1780] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:15 2022] PUT /identity/v3/projects/4c48f92d3085464a955a83dbfe08b0e9/users/1c6c226d4ee44ea587725e27fd642ccd/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:15.902092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51ef7-be02-4c6b-b8fa-0a79f68225a6 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:15.902092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51ef7-be02-4c6b-b8fa-0a79f68225a6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:15.902092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51ef7-be02-4c6b-b8fa-0a79f68225a6 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:15.902092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 882/1781] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:23:15.902092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed51ef7-be02-4c6b-b8fa-0a79f68225a6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:15.902652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:15.998014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45750275-f86d-4ffc-89fa-c8a40fe11980 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:16.031744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed51ef7-be02-4c6b-b8fa-0a79f68225a6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:16.037272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1ccb-040c-4597-be88-cb13fe908aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:16.038151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1ccb-040c-4597-be88-cb13fe908aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.039261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1ccb-040c-4597-be88-cb13fe908aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.039757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1ccb-040c-4597-be88-cb13fe908aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:16.042042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1ccb-040c-4597-be88-cb13fe908aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:16.054303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1ccb-040c-4597-be88-cb13fe908aa7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:16.100928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08287f3-adbc-447e-8ad3-e92f69f24949 tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea6abf3c56a64d97af3cd6cb0abdbb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5960513cc9644a9ebf79ccf44b5a767b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:16.103361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08287f3-adbc-447e-8ad3-e92f69f24949 tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.103458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08287f3-adbc-447e-8ad3-e92f69f24949 tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.103854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08287f3-adbc-447e-8ad3-e92f69f24949 tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:16.110715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08287f3-adbc-447e-8ad3-e92f69f24949 tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:16.110715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08287f3-adbc-447e-8ad3-e92f69f24949 tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:16.110715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08287f3-adbc-447e-8ad3-e92f69f24949 tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:16.139229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 900/1782] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:16.142207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08287f3-adbc-447e-8ad3-e92f69f24949 tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:16.158968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08287f3-adbc-447e-8ad3-e92f69f24949 tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:16.166851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 883/1783] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:15 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:16.168278 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d5a9-a0cc-4d7f-a503-5bbc5477a475 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.168649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d5a9-a0cc-4d7f-a503-5bbc5477a475 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.168803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f69d4b-0398-47e4-a6b9-f243db27d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:16.168930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d5a9-a0cc-4d7f-a503-5bbc5477a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:16.170424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f69d4b-0398-47e4-a6b9-f243db27d78e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.170938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f69d4b-0398-47e4-a6b9-f243db27d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.171376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f69d4b-0398-47e4-a6b9-f243db27d78e admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:16.172401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f69d4b-0398-47e4-a6b9-f243db27d78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:16.174237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f69d4b-0398-47e4-a6b9-f243db27d78e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:16.208959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 901/1784] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:16.208959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d97be5-3ff2-4881-ac82-0e3c97dcafce None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.208959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d97be5-3ff2-4881-ac82-0e3c97dcafce None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.208959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d97be5-3ff2-4881-ac82-0e3c97dcafce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:16.241438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d7d97be5-3ff2-4881-ac82-0e3c97dcafce None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:16.243071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d7d97be5-3ff2-4881-ac82-0e3c97dcafce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:16.253003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-99c9d5a9-a0cc-4d7f-a503-5bbc5477a475 None None] MFA Rules not processed for user `1c6c226d4ee44ea587725e27fd642ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:16.255554 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-99c9d5a9-a0cc-4d7f-a503-5bbc5477a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:16.349069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 902/1785] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:23:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:16.351565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d97be5-3ff2-4881-ac82-0e3c97dcafce None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:16.381982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d97be5-3ff2-4881-ac82-0e3c97dcafce None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:16.396437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d56c1-5008-4c02-a5ac-78edec8156e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:16.398787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d56c1-5008-4c02-a5ac-78edec8156e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.399345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d56c1-5008-4c02-a5ac-78edec8156e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.400953 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d56c1-5008-4c02-a5ac-78edec8156e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:16.409491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d56c1-5008-4c02-a5ac-78edec8156e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:16.409491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d56c1-5008-4c02-a5ac-78edec8156e0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:16.446204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 903/1786] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:16.456279 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 884/1787] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:16 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:16.457136 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d56c1-5008-4c02-a5ac-78edec8156e0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:16.457393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9d5a9-a0cc-4d7f-a503-5bbc5477a475 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:16.480021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9d5a9-a0cc-4d7f-a503-5bbc5477a475 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:16.481378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d56c1-5008-4c02-a5ac-78edec8156e0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:16.486657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea6abf3c56a64d97af3cd6cb0abdbb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5960513cc9644a9ebf79ccf44b5a767b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:16.487356 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71417a4f-589b-4d56-ad5d-ec25143ef9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:16.487976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.488464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.488886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417a4f-589b-4d56-ad5d-ec25143ef9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.489038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] PATH_INFO: `/v3/projects/e9faecac3bb74f4d882658c07583a7b5` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:16.489343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417a4f-589b-4d56-ad5d-ec25143ef9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.489881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417a4f-589b-4d56-ad5d-ec25143ef9ec admin admin] PATH_INFO: `/v3/projects/0918ca53ca95411cafa1df1711e62970/users/992cbe3b739c410eb17ea546e919a071/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:16.490730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9faecac3bb74f4d882658c07583a7b5)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:16.492932 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:16.518977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71417a4f-589b-4d56-ad5d-ec25143ef9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0918ca53ca95411cafa1df1711e62970, user_id=992cbe3b739c410eb17ea546e919a071, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:16.526466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71417a4f-589b-4d56-ad5d-ec25143ef9ec admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:16.687697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 885/1788] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:16 2022] PUT /identity/v3/projects/0918ca53ca95411cafa1df1711e62970/users/992cbe3b739c410eb17ea546e919a071/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:16.687697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71417a4f-589b-4d56-ad5d-ec25143ef9ec admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:16.694651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9faecac3bb74f4d882658c07583a7b5', 'request_id': 'req-635bbd9c-7008-4d29-91d1-d9ed285e31db'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:16.703363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:16.796560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9faecac3bb74f4d882658c07583a7b5', 'request_id': 'req-635bbd9c-7008-4d29-91d1-d9ed285e31db'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:16.806023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9faecac3bb74f4d882658c07583a7b5', 'request_id': 'req-635bbd9c-7008-4d29-91d1-d9ed285e31db'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:16.810219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71417a4f-589b-4d56-ad5d-ec25143ef9ec admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:16.840028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] The token cache is being invalidate because project e9faecac3bb74f4d882658c07583a7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:16.840472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:16.841892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:16.848239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 904/1789] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:16 2022] DELETE /identity/v3/projects/e9faecac3bb74f4d882658c07583a7b5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:16.848239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:16.848772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:16.906745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2401-5b6e-4962-be99-c8d2d20c27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:16.912741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2401-5b6e-4962-be99-c8d2d20c27c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.912741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2401-5b6e-4962-be99-c8d2d20c27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.912741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2401-5b6e-4962-be99-c8d2d20c27c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:16.912741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2401-5b6e-4962-be99-c8d2d20c27c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:16.912741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2401-5b6e-4962-be99-c8d2d20c27c8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:16.944633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 886/1790] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:16.944633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2401-5b6e-4962-be99-c8d2d20c27c8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:16.948180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f2cb2401-5b6e-4962-be99-c8d2d20c27c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:16.984139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bbd9c-7008-4d29-91d1-d9ed285e31db tempest-VolumeQuotaClassesTest-1682600023 tempest-VolumeQuotaClassesTest-1682600023-project-admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:16.990862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adcffd-a8bf-4b38-a5e6-18fa60a605ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:16.991609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adcffd-a8bf-4b38-a5e6-18fa60a605ce service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:16.992735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adcffd-a8bf-4b38-a5e6-18fa60a605ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:16.993170 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adcffd-a8bf-4b38-a5e6-18fa60a605ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:17.017524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e9adcffd-a8bf-4b38-a5e6-18fa60a605ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:17.077015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2401-5b6e-4962-be99-c8d2d20c27c8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:17.085627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:17.086954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:17.089065 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:17.113165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:17.113165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:17.113165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:17.113165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:17.113496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adcffd-a8bf-4b38-a5e6-18fa60a605ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:17.113496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adcffd-a8bf-4b38-a5e6-18fa60a605ce service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:17.123545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 887/1791] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:17.124256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 905/1792] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:16 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:17.126389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bc0ca-ad09-4cbd-b775-6030c24a6cb9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:17.127079 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bc0ca-ad09-4cbd-b775-6030c24a6cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:17.143002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bc0ca-ad09-4cbd-b775-6030c24a6cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:17.175245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:17.201349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:17.201349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbcf22-36f9-4887-ad61-05bf540cb20c service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:17.204617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1c7bc0ca-ad09-4cbd-b775-6030c24a6cb9 None None] MFA Rules not processed for user `992cbe3b739c410eb17ea546e919a071`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:17.205255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e886e84-b73b-42e3-b096-5c09b767cc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:17.208075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1c7bc0ca-ad09-4cbd-b775-6030c24a6cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:17.208824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e886e84-b73b-42e3-b096-5c09b767cc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:17.209410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e886e84-b73b-42e3-b096-5c09b767cc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:17.209901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e886e84-b73b-42e3-b096-5c09b767cc62 admin admin] PATH_INFO: `/v3/projects/ba0ee0e496424eaba46245944c995ce7/users/630ba8b9323a42488ce108e63d185d49/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:17.235143 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e886e84-b73b-42e3-b096-5c09b767cc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0ee0e496424eaba46245944c995ce7, user_id=630ba8b9323a42488ce108e63d185d49, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:17.241594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e886e84-b73b-42e3-b096-5c09b767cc62 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:17.393566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 906/1793] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:17.398682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bc0ca-ad09-4cbd-b775-6030c24a6cb9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:17.400060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1c7bc0ca-ad09-4cbd-b775-6030c24a6cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:17.414838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bc0ca-ad09-4cbd-b775-6030c24a6cb9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:17.438318 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c012d-051a-447f-9262-095b4795cb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:17.439320 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c012d-051a-447f-9262-095b4795cb00 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:17.443875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c012d-051a-447f-9262-095b4795cb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:17.444386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c012d-051a-447f-9262-095b4795cb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:17.445724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c012d-051a-447f-9262-095b4795cb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:17.449186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c012d-051a-447f-9262-095b4795cb00 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:18.371703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:18.430637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 888/1794] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:17 2022] PUT /identity/v3/projects/ba0ee0e496424eaba46245944c995ce7/users/630ba8b9323a42488ce108e63d185d49/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 1256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:18.437797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 907/1795] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:17 2022] POST /identity/v3/projects => generated 367 bytes in 1040 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:18.441278 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0b8a-6006-46c4-8de6-371a7a9aed4f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:18.441968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0b8a-6006-46c4-8de6-371a7a9aed4f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:18.443040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c012d-051a-447f-9262-095b4795cb00 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:18.443620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0b8a-6006-46c4-8de6-371a7a9aed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:18.473179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-500f0b8a-6006-46c4-8de6-371a7a9aed4f None None] MFA Rules not processed for user `630ba8b9323a42488ce108e63d185d49`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:18.474417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-500f0b8a-6006-46c4-8de6-371a7a9aed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:18.518769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c012d-051a-447f-9262-095b4795cb00 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:18.531236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299525b-6fff-4195-8077-90f30f3bd17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:18.532132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299525b-6fff-4195-8077-90f30f3bd17a admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:18.532552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299525b-6fff-4195-8077-90f30f3bd17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:18.532936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299525b-6fff-4195-8077-90f30f3bd17a admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:18.533749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299525b-6fff-4195-8077-90f30f3bd17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:18.541662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299525b-6fff-4195-8077-90f30f3bd17a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:18.577861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 889/1796] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:18.577861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f0b8a-6006-46c4-8de6-371a7a9aed4f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:18.648222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f0b8a-6006-46c4-8de6-371a7a9aed4f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:18.652602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c861f60-4730-4874-bcb3-1961af3ff106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:18.653299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c861f60-4730-4874-bcb3-1961af3ff106 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:18.653625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c861f60-4730-4874-bcb3-1961af3ff106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:18.653936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c861f60-4730-4874-bcb3-1961af3ff106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:18.656259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9c861f60-4730-4874-bcb3-1961af3ff106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:18.666314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 908/1797] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:18 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:18.666314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299525b-6fff-4195-8077-90f30f3bd17a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:18.678530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299525b-6fff-4195-8077-90f30f3bd17a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:18.686175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a66695-d806-4fc7-8588-03fd1e71860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:18.687159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a66695-d806-4fc7-8588-03fd1e71860b admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:18.687489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a66695-d806-4fc7-8588-03fd1e71860b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:18.687772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a66695-d806-4fc7-8588-03fd1e71860b admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:18.689695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a66695-d806-4fc7-8588-03fd1e71860b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:18.692228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a66695-d806-4fc7-8588-03fd1e71860b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:18.747118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c861f60-4730-4874-bcb3-1961af3ff106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:18.748913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c861f60-4730-4874-bcb3-1961af3ff106 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:18.760646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 890/1798] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:18 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:18.761662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c861f60-4730-4874-bcb3-1961af3ff106 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:18.774034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c861f60-4730-4874-bcb3-1961af3ff106 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:18.779400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4ef0e-8a9f-435b-af83-faadac0244d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:18.780083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4ef0e-8a9f-435b-af83-faadac0244d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:18.780400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4ef0e-8a9f-435b-af83-faadac0244d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:18.785946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4ef0e-8a9f-435b-af83-faadac0244d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:18.785946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4ef0e-8a9f-435b-af83-faadac0244d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:18.785946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4ef0e-8a9f-435b-af83-faadac0244d4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:18.798121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 891/1799] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:18.798906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4ef0e-8a9f-435b-af83-faadac0244d4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:18.814087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4ef0e-8a9f-435b-af83-faadac0244d4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:18.814777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 909/1800] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:18 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:18.818524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a66695-d806-4fc7-8588-03fd1e71860b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:18.910258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aa5df-408c-4417-9166-b5ee7881b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:18.911829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aa5df-408c-4417-9166-b5ee7881b39f admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:18.912230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aa5df-408c-4417-9166-b5ee7881b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:18.912779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aa5df-408c-4417-9166-b5ee7881b39f admin admin] PATH_INFO: `/v3/projects/34b88a850ca54ce992810fd589942ff9/users/6f5ec209bd55457a82fea3c8dcf55f32/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:18.926939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a66695-d806-4fc7-8588-03fd1e71860b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:18.932172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba68aa-3813-4740-818e-4b1a1b4effb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:18.935699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba68aa-3813-4740-818e-4b1a1b4effb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:18.935699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba68aa-3813-4740-818e-4b1a1b4effb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:18.935699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba68aa-3813-4740-818e-4b1a1b4effb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:18.935699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba68aa-3813-4740-818e-4b1a1b4effb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:18.936237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba68aa-3813-4740-818e-4b1a1b4effb0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:18.951667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5aa5df-408c-4417-9166-b5ee7881b39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b88a850ca54ce992810fd589942ff9, user_id=6f5ec209bd55457a82fea3c8dcf55f32, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:18.964437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5aa5df-408c-4417-9166-b5ee7881b39f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.020287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 910/1801] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:18 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:19.021618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba68aa-3813-4740-818e-4b1a1b4effb0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:19.032216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba68aa-3813-4740-818e-4b1a1b4effb0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:19.036929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72079d28-ef15-4f25-bc97-7d06cd622be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:19.037602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72079d28-ef15-4f25-bc97-7d06cd622be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.044268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72079d28-ef15-4f25-bc97-7d06cd622be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.049086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72079d28-ef15-4f25-bc97-7d06cd622be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.049086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72079d28-ef15-4f25-bc97-7d06cd622be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:19.049086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72079d28-ef15-4f25-bc97-7d06cd622be1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.057981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 911/1802] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:19.061990 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72079d28-ef15-4f25-bc97-7d06cd622be1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:19.072919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72079d28-ef15-4f25-bc97-7d06cd622be1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:19.079991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 892/1803] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:18 2022] PUT /identity/v3/projects/34b88a850ca54ce992810fd589942ff9/users/6f5ec209bd55457a82fea3c8dcf55f32/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:19.082623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aa5df-408c-4417-9166-b5ee7881b39f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:19.153468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56120b56-6a0a-4a89-9601-69ce337d45fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:19.154625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56120b56-6a0a-4a89-9601-69ce337d45fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.154835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56120b56-6a0a-4a89-9601-69ce337d45fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.155192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56120b56-6a0a-4a89-9601-69ce337d45fe admin admin] PATH_INFO: `/v3/projects/c73183013a0a483ba4da39d489dbe6bb/users/e8c42b4776234162a8441449dc2ccace/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.167926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:19.175429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aa5df-408c-4417-9166-b5ee7881b39f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:19.177719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56120b56-6a0a-4a89-9601-69ce337d45fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73183013a0a483ba4da39d489dbe6bb, user_id=e8c42b4776234162a8441449dc2ccace, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:19.180434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56120b56-6a0a-4a89-9601-69ce337d45fe admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.181474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fa1c4-b590-4c4a-aef3-c6c71b376947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:19.182307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fa1c4-b590-4c4a-aef3-c6c71b376947 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.182688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fa1c4-b590-4c4a-aef3-c6c71b376947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.183053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fa1c4-b590-4c4a-aef3-c6c71b376947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.184145 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fa1c4-b590-4c4a-aef3-c6c71b376947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:19.186071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fa1c4-b590-4c4a-aef3-c6c71b376947 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.198005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 893/1804] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:19.199565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fa1c4-b590-4c4a-aef3-c6c71b376947 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:19.202752 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c14fa1c4-b590-4c4a-aef3-c6c71b376947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:19.220627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fa1c4-b590-4c4a-aef3-c6c71b376947 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:19.225449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:19.226912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.227318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.227601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] PATH_INFO: `/v3/users/703024cf354c490582e9f00af03589fb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.228861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=703024cf354c490582e9f00af03589fb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:19.230817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.302222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 912/1805] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:19 2022] PUT /identity/v3/projects/c73183013a0a483ba4da39d489dbe6bb/users/e8c42b4776234162a8441449dc2ccace/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:19.307935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56120b56-6a0a-4a89-9601-69ce337d45fe admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:19.373815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56120b56-6a0a-4a89-9601-69ce337d45fe admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:19.378437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdd938-0580-4e93-a369-38dd6c7f939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:19.379422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdd938-0580-4e93-a369-38dd6c7f939b admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.379826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdd938-0580-4e93-a369-38dd6c7f939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.380173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdd938-0580-4e93-a369-38dd6c7f939b admin admin] PATH_INFO: `/v3/projects/34b88a850ca54ce992810fd589942ff9/users/6f5ec209bd55457a82fea3c8dcf55f32/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.391139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdd938-0580-4e93-a369-38dd6c7f939b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b88a850ca54ce992810fd589942ff9, user_id=6f5ec209bd55457a82fea3c8dcf55f32, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:19.394577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdd938-0580-4e93-a369-38dd6c7f939b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.415205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '703024cf354c490582e9f00af03589fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:19.421480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 913/1806] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:19 2022] PUT /identity/v3/projects/34b88a850ca54ce992810fd589942ff9/users/6f5ec209bd55457a82fea3c8dcf55f32/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:19.424205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '703024cf354c490582e9f00af03589fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:19.424358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdd938-0580-4e93-a369-38dd6c7f939b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:19.424989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '703024cf354c490582e9f00af03589fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:19.428892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:19.451979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '703024cf354c490582e9f00af03589fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:19.498525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdd938-0580-4e93-a369-38dd6c7f939b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:19.503359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954abc6-171f-464b-a38c-c0c27ff90669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:19.506584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954abc6-171f-464b-a38c-c0c27ff90669 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.506584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954abc6-171f-464b-a38c-c0c27ff90669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.506584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954abc6-171f-464b-a38c-c0c27ff90669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.506584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954abc6-171f-464b-a38c-c0c27ff90669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:19.506946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954abc6-171f-464b-a38c-c0c27ff90669 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.516870 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 914/1807] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:19.518218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f3f4-3169-450b-8da7-bf36e8e48865 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.518508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f3f4-3169-450b-8da7-bf36e8e48865 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.518788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f3f4-3169-450b-8da7-bf36e8e48865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.544593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3e12f3f4-3169-450b-8da7-bf36e8e48865 None None] MFA Rules not processed for user `6f5ec209bd55457a82fea3c8dcf55f32`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:19.545851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3e12f3f4-3169-450b-8da7-bf36e8e48865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:19.555492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '703024cf354c490582e9f00af03589fb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:19.565795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 894/1808] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:19 2022] DELETE /identity/v3/users/703024cf354c490582e9f00af03589fb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:19.565795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:19.565795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:19.620601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 915/1809] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:19.621928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851c1d6-5a92-496a-a297-75846b10d75f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.622208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851c1d6-5a92-496a-a297-75846b10d75f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.622484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851c1d6-5a92-496a-a297-75846b10d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.646840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b851c1d6-5a92-496a-a297-75846b10d75f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:19.648748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b851c1d6-5a92-496a-a297-75846b10d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:19.653798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f0c1-ddc4-4bd4-9f9f-407f921dc00c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:19.656661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 916/1810] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:19.657458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851c1d6-5a92-496a-a297-75846b10d75f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:19.658681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b851c1d6-5a92-496a-a297-75846b10d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:19.662387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e61c8f-960a-4aec-a0ad-124630469df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:19.663269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e61c8f-960a-4aec-a0ad-124630469df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.663555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e61c8f-960a-4aec-a0ad-124630469df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.664659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e61c8f-960a-4aec-a0ad-124630469df0 admin admin] PATH_INFO: `/v3/projects/c73183013a0a483ba4da39d489dbe6bb/users/e8c42b4776234162a8441449dc2ccace/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.667820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e61c8f-960a-4aec-a0ad-124630469df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73183013a0a483ba4da39d489dbe6bb, user_id=e8c42b4776234162a8441449dc2ccace, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:19.671710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e61c8f-960a-4aec-a0ad-124630469df0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.697998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 895/1811] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:19 2022] PUT /identity/v3/projects/c73183013a0a483ba4da39d489dbe6bb/users/e8c42b4776234162a8441449dc2ccace/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:19.698974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e61c8f-960a-4aec-a0ad-124630469df0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:19.700699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d8e61c8f-960a-4aec-a0ad-124630469df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:19.749949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851c1d6-5a92-496a-a297-75846b10d75f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:19.807460 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e61c8f-960a-4aec-a0ad-124630469df0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:19.820347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0e7bf-eca5-447b-8115-02e6ea28fbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:19.821584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0e7bf-eca5-447b-8115-02e6ea28fbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.822056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0e7bf-eca5-447b-8115-02e6ea28fbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.822480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0e7bf-eca5-447b-8115-02e6ea28fbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.866294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f75ec-6f0b-4fbd-a854-fdc12070e393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:19.867250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f75ec-6f0b-4fbd-a854-fdc12070e393 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.867535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f75ec-6f0b-4fbd-a854-fdc12070e393 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.867819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f75ec-6f0b-4fbd-a854-fdc12070e393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.912429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0e7bf-eca5-447b-8115-02e6ea28fbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:19.914536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0e7bf-eca5-447b-8115-02e6ea28fbc6 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.943220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 896/1812] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:19.948977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ed3cc-3724-4db0-a15b-5b5f2e7ff462 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:19.949280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ed3cc-3724-4db0-a15b-5b5f2e7ff462 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:19.949615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ed3cc-3724-4db0-a15b-5b5f2e7ff462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:19.962371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f75ec-6f0b-4fbd-a854-fdc12070e393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:19.965282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f75ec-6f0b-4fbd-a854-fdc12070e393 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:19.981978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 917/1813] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:19.997171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5c5ed3cc-3724-4db0-a15b-5b5f2e7ff462 None None] MFA Rules not processed for user `e8c42b4776234162a8441449dc2ccace`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:19.998958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5c5ed3cc-3724-4db0-a15b-5b5f2e7ff462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:20.079525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 897/1814] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:20.090876 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f75ec-6f0b-4fbd-a854-fdc12070e393 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:20.092256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b30f75ec-6f0b-4fbd-a854-fdc12070e393 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:20.103436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f75ec-6f0b-4fbd-a854-fdc12070e393 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:20.107241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61f0d4-bb1c-4780-9388-391e1e28cd79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:20.107883 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f0d4-bb1c-4780-9388-391e1e28cd79 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:20.108164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f0d4-bb1c-4780-9388-391e1e28cd79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:20.108474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f0d4-bb1c-4780-9388-391e1e28cd79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:20.117718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61f0d4-bb1c-4780-9388-391e1e28cd79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:20.119147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61f0d4-bb1c-4780-9388-391e1e28cd79 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:20.143999 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 918/1815] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:20.164098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ed3cc-3724-4db0-a15b-5b5f2e7ff462 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:20.193621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ed3cc-3724-4db0-a15b-5b5f2e7ff462 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:20.201317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311d626-c0ff-4354-8418-39eab020fe58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:20.202297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311d626-c0ff-4354-8418-39eab020fe58 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:20.202802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311d626-c0ff-4354-8418-39eab020fe58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:20.203296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311d626-c0ff-4354-8418-39eab020fe58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:20.205517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a311d626-c0ff-4354-8418-39eab020fe58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:20.285664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311d626-c0ff-4354-8418-39eab020fe58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:20.285664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311d626-c0ff-4354-8418-39eab020fe58 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:20.294054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 898/1816] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:20.503950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61f0d4-bb1c-4780-9388-391e1e28cd79 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:20.503950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3d61f0d4-bb1c-4780-9388-391e1e28cd79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:20.514726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61f0d4-bb1c-4780-9388-391e1e28cd79 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:20.519647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:20.521523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:20.521818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:20.526671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] PATH_INFO: `/v3/projects/bd99ac809ac34350b137754e566bfa5f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:20.526671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd99ac809ac34350b137754e566bfa5f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:20.526671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:20.640686 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd99ac809ac34350b137754e566bfa5f', 'request_id': 'req-c3b86792-4462-43ec-9c51-424bbe37aa36'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:20.725248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd99ac809ac34350b137754e566bfa5f', 'request_id': 'req-c3b86792-4462-43ec-9c51-424bbe37aa36'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:20.732044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd99ac809ac34350b137754e566bfa5f', 'request_id': 'req-c3b86792-4462-43ec-9c51-424bbe37aa36'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:20.759443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] The token cache is being invalidate because project bd99ac809ac34350b137754e566bfa5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:20.759443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:20.760442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:20.763561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 919/1817] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:20 2022] DELETE /identity/v3/projects/bd99ac809ac34350b137754e566bfa5f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:20.767422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311d626-c0ff-4354-8418-39eab020fe58 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:20.779492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311d626-c0ff-4354-8418-39eab020fe58 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:20.843354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:20.844562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:20.848735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:20.849038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] PATH_INFO: `/v3/users/ea6abf3c56a64d97af3cd6cb0abdbb5e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:20.850493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6abf3c56a64d97af3cd6cb0abdbb5e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:20.852813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:21.068009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:21.109886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6abf3c56a64d97af3cd6cb0abdbb5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.116647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6abf3c56a64d97af3cd6cb0abdbb5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.117835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6abf3c56a64d97af3cd6cb0abdbb5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.120015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:21.130196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6abf3c56a64d97af3cd6cb0abdbb5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.211386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a96f5799-8a8a-4ecb-9907-688f3d2485bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6abf3c56a64d97af3cd6cb0abdbb5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.222069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 899/1818] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:20 2022] DELETE /identity/v3/users/ea6abf3c56a64d97af3cd6cb0abdbb5e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:21.281626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:21.283069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:21.296415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b86792-4462-43ec-9c51-424bbe37aa36 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:21.353730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:21.354646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:21.354935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:21.355215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] PATH_INFO: `/v3/users/630ba8b9323a42488ce108e63d185d49` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:21.356444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630ba8b9323a42488ce108e63d185d49)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:21.358404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:21.544498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630ba8b9323a42488ce108e63d185d49'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.545309 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630ba8b9323a42488ce108e63d185d49'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.565396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630ba8b9323a42488ce108e63d185d49'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.566245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630ba8b9323a42488ce108e63d185d49'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.586334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630ba8b9323a42488ce108e63d185d49'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.669235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 920/1819] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:21 2022] DELETE /identity/v3/users/630ba8b9323a42488ce108e63d185d49 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:21.673728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9189c92-eb0c-4445-8cd0-457992b02d11 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:21.674027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9189c92-eb0c-4445-8cd0-457992b02d11 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:21.674315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9189c92-eb0c-4445-8cd0-457992b02d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:21.693327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e9189c92-eb0c-4445-8cd0-457992b02d11 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:21.693327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e9189c92-eb0c-4445-8cd0-457992b02d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:21.739998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:21.742818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:21.756011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 900/1820] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:21.766319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9189c92-eb0c-4445-8cd0-457992b02d11 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:21.767735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e9189c92-eb0c-4445-8cd0-457992b02d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:21.818741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae461-28f8-4aef-bf5b-b4adbeeefdd4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:21.824158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:21.825051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:21.825334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:21.825619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] PATH_INFO: `/v3/projects/5960513cc9644a9ebf79ccf44b5a767b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:21.827793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5960513cc9644a9ebf79ccf44b5a767b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:21.829755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:21.833257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9189c92-eb0c-4445-8cd0-457992b02d11 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:21.837841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34534a-503c-4b64-8c95-f3f34b4524ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:21.838766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34534a-503c-4b64-8c95-f3f34b4524ee service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:21.839062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34534a-503c-4b64-8c95-f3f34b4524ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:21.839351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34534a-503c-4b64-8c95-f3f34b4524ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:21.854918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34534a-503c-4b64-8c95-f3f34b4524ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:21.856529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34534a-503c-4b64-8c95-f3f34b4524ee service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:21.866240 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 901/1821] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:23:21.921273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5960513cc9644a9ebf79ccf44b5a767b', 'request_id': 'req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.993481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5960513cc9644a9ebf79ccf44b5a767b', 'request_id': 'req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:21.999605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5960513cc9644a9ebf79ccf44b5a767b', 'request_id': 'req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:22.011240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] The token cache is being invalidate because project 5960513cc9644a9ebf79ccf44b5a767b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:22.011531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:22.012168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f6f2fdd4-8aa2-41eb-a09a-7b2a5bf365df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:22.013752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 921/1822] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:21 2022] DELETE /identity/v3/projects/5960513cc9644a9ebf79ccf44b5a767b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:22.018632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c2acc-c1db-42ca-b695-0fe642ed7b05 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.025382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c2acc-c1db-42ca-b695-0fe642ed7b05 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.025382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c2acc-c1db-42ca-b695-0fe642ed7b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.038782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3d3c2acc-c1db-42ca-b695-0fe642ed7b05 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:22.039961 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3d3c2acc-c1db-42ca-b695-0fe642ed7b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:22.101437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 902/1823] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:22.108009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340d5da-88fa-476c-9adc-49d16bb618df None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.108325 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340d5da-88fa-476c-9adc-49d16bb618df None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.108621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340d5da-88fa-476c-9adc-49d16bb618df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.114218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:22.131129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9340d5da-88fa-476c-9adc-49d16bb618df None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:22.132390 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9340d5da-88fa-476c-9adc-49d16bb618df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:22.140980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 922/1824] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:22.145689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c2acc-c1db-42ca-b695-0fe642ed7b05 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:22.157336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c2acc-c1db-42ca-b695-0fe642ed7b05 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:22.161970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:22.162641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.162928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.163207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.164006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:22.164330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:22.166091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:22.180347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 903/1825] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:22.184593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340d5da-88fa-476c-9adc-49d16bb618df None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:22.194988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340d5da-88fa-476c-9adc-49d16bb618df None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:22.200908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2bb86-4733-4c47-8d36-f1ef86a10b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:22.201576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2bb86-4733-4c47-8d36-f1ef86a10b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.201868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2bb86-4733-4c47-8d36-f1ef86a10b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.202146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2bb86-4733-4c47-8d36-f1ef86a10b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.202841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2bb86-4733-4c47-8d36-f1ef86a10b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:22.204783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2bb86-4733-4c47-8d36-f1ef86a10b46 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:22.217800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:22.361673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:22.370388 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:22.370470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 923/1826] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:22 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:22.371911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2bb86-4733-4c47-8d36-f1ef86a10b46 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:22.383747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673fde3-43ce-4e6c-a478-8364f2b00a11 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:22.442649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:22.443608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.443899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.444180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] PATH_INFO: `/v3/projects/ba0ee0e496424eaba46245944c995ce7` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.446031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0ee0e496424eaba46245944c995ce7)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:22.447810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2bb86-4733-4c47-8d36-f1ef86a10b46 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:22.448077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:22.453041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0452f-9af8-439b-bece-8ef757333056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:22.453710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0452f-9af8-439b-bece-8ef757333056 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.453997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0452f-9af8-439b-bece-8ef757333056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.454273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0452f-9af8-439b-bece-8ef757333056 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.454989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0452f-9af8-439b-bece-8ef757333056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:22.456968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0452f-9af8-439b-bece-8ef757333056 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:22.591534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 924/1827] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:22 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:22.595433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0452f-9af8-439b-bece-8ef757333056 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:22.601941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0ee0e496424eaba46245944c995ce7', 'request_id': 'req-a5d76529-1681-4162-a6ff-21409256d918'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:22.616412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0452f-9af8-439b-bece-8ef757333056 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:22.686213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0ee0e496424eaba46245944c995ce7', 'request_id': 'req-a5d76529-1681-4162-a6ff-21409256d918'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:22.693776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa804d-03c9-4d0f-b11a-2dc0a75ed96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:22.695364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa804d-03c9-4d0f-b11a-2dc0a75ed96c admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.695517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0ee0e496424eaba46245944c995ce7', 'request_id': 'req-a5d76529-1681-4162-a6ff-21409256d918'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:22.696067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa804d-03c9-4d0f-b11a-2dc0a75ed96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.696538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa804d-03c9-4d0f-b11a-2dc0a75ed96c admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.697621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa804d-03c9-4d0f-b11a-2dc0a75ed96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:22.700758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa804d-03c9-4d0f-b11a-2dc0a75ed96c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:22.708670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] The token cache is being invalidate because project ba0ee0e496424eaba46245944c995ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:22.709003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:22.710119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:22.715633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 904/1828] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:22 2022] DELETE /identity/v3/projects/ba0ee0e496424eaba46245944c995ce7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:22.716712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:22.718130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:22.719382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 925/1829] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:22.723942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa804d-03c9-4d0f-b11a-2dc0a75ed96c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:22.729659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fafa804d-03c9-4d0f-b11a-2dc0a75ed96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:22.733101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d76529-1681-4162-a6ff-21409256d918 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:22.741737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:22.743470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.743760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.744039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] PATH_INFO: `/v3/users/e8c42b4776234162a8441449dc2ccace` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.745290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c42b4776234162a8441449dc2ccace)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:22.747028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa804d-03c9-4d0f-b11a-2dc0a75ed96c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:22.754885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:22.760927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3e9c1-b71b-457b-b740-00d7883ccd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:22.763191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3e9c1-b71b-457b-b740-00d7883ccd1b admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.764044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3e9c1-b71b-457b-b740-00d7883ccd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.765008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3e9c1-b71b-457b-b740-00d7883ccd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.767289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3e9c1-b71b-457b-b740-00d7883ccd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:22.771156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3e9c1-b71b-457b-b740-00d7883ccd1b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:22.803836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 926/1830] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:22.806147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3e9c1-b71b-457b-b740-00d7883ccd1b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:22.831976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3e9c1-b71b-457b-b740-00d7883ccd1b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:22.841494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed707a-8c8d-440f-bdbd-171e0014c1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:22.842637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed707a-8c8d-440f-bdbd-171e0014c1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.842926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed707a-8c8d-440f-bdbd-171e0014c1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.843213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed707a-8c8d-440f-bdbd-171e0014c1cc admin admin] PATH_INFO: `/v3/projects/292538cf537246e692352583c880f51a/users/e15012a2a0e444aaa2238ab7e15d955f/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.868640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed707a-8c8d-440f-bdbd-171e0014c1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=292538cf537246e692352583c880f51a, user_id=e15012a2a0e444aaa2238ab7e15d955f, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:22.871947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed707a-8c8d-440f-bdbd-171e0014c1cc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:22.959939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:22.966076 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 927/1831] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:22 2022] PUT /identity/v3/projects/292538cf537246e692352583c880f51a/users/e15012a2a0e444aaa2238ab7e15d955f/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:22.977217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182baa68-d34f-412f-bcda-47d11df9cd7d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:22.977759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182baa68-d34f-412f-bcda-47d11df9cd7d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:22.978191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182baa68-d34f-412f-bcda-47d11df9cd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:22.996650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c42b4776234162a8441449dc2ccace'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.004980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c42b4776234162a8441449dc2ccace'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.007073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c42b4776234162a8441449dc2ccace'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.010876 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-182baa68-d34f-412f-bcda-47d11df9cd7d None None] MFA Rules not processed for user `e15012a2a0e444aaa2238ab7e15d955f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:23.012077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-182baa68-d34f-412f-bcda-47d11df9cd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:23.018425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:23.020859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c42b4776234162a8441449dc2ccace'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.081680 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 928/1832] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:23.084780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182baa68-d34f-412f-bcda-47d11df9cd7d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:23.102881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c42b4776234162a8441449dc2ccace'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.109628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 905/1833] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:22 2022] DELETE /identity/v3/users/e8c42b4776234162a8441449dc2ccace => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:23.146453 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182baa68-d34f-412f-bcda-47d11df9cd7d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:23.203019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6edf4-96b4-435a-bac1-d7d181598406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:23.203641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6edf4-96b4-435a-bac1-d7d181598406 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:23.203925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6edf4-96b4-435a-bac1-d7d181598406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:23.204196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6edf4-96b4-435a-bac1-d7d181598406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:23.204911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6edf4-96b4-435a-bac1-d7d181598406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:23.206863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6edf4-96b4-435a-bac1-d7d181598406 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:23.340026 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 929/1834] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:23 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:23.340106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:23.341673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:23.374543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532bb1-2b5a-4adb-a6f9-2064eb1c0d56 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:23.466669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7c5f3-e8ea-490d-b317-ba7358650d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:23.467372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7c5f3-e8ea-490d-b317-ba7358650d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:23.467660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7c5f3-e8ea-490d-b317-ba7358650d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:23.467949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7c5f3-e8ea-490d-b317-ba7358650d3f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:23.468716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7c5f3-e8ea-490d-b317-ba7358650d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:23.470835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7c5f3-e8ea-490d-b317-ba7358650d3f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:23.591242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 906/1835] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:23 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:23.595196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6edf4-96b4-435a-bac1-d7d181598406 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:23.605364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6edf4-96b4-435a-bac1-d7d181598406 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:23.610193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4d20e-ebf7-4038-aacb-4018ce65433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:23.610857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4d20e-ebf7-4038-aacb-4018ce65433b admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:23.611143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4d20e-ebf7-4038-aacb-4018ce65433b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:23.611421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4d20e-ebf7-4038-aacb-4018ce65433b admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:23.612140 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4d20e-ebf7-4038-aacb-4018ce65433b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:23.613772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4d20e-ebf7-4038-aacb-4018ce65433b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:23.622158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7c5f3-e8ea-490d-b317-ba7358650d3f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:23.623939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c2a7c5f3-e8ea-490d-b317-ba7358650d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:23.629289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 930/1836] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:23.630872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4d20e-ebf7-4038-aacb-4018ce65433b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:23.640626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7c5f3-e8ea-490d-b317-ba7358650d3f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:23.643500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4d20e-ebf7-4038-aacb-4018ce65433b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:23.645435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:23.646311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:23.646591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:23.646855 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] PATH_INFO: `/v3/projects/c73183013a0a483ba4da39d489dbe6bb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:23.648055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73183013a0a483ba4da39d489dbe6bb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:23.649651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7c4d-acac-442d-97c3-7344a523b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:23.650196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7c4d-acac-442d-97c3-7344a523b97a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:23.650521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7c4d-acac-442d-97c3-7344a523b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:23.650739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7c4d-acac-442d-97c3-7344a523b97a admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:23.651194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:23.651452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe7c4d-acac-442d-97c3-7344a523b97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:23.653106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe7c4d-acac-442d-97c3-7344a523b97a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:23.666421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 931/1837] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:23.667424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7c4d-acac-442d-97c3-7344a523b97a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:23.677467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7c4d-acac-442d-97c3-7344a523b97a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:23.682171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d41644-5e78-4edb-97c8-12be5af352f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:23.683124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d41644-5e78-4edb-97c8-12be5af352f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:23.683402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d41644-5e78-4edb-97c8-12be5af352f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:23.683674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d41644-5e78-4edb-97c8-12be5af352f5 admin admin] PATH_INFO: `/v3/projects/6d4f8a8e13d8435a8ed2b814354acb03/users/62823bbb5a6c417eadba31f518b830cb/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:23.702713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d41644-5e78-4edb-97c8-12be5af352f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4f8a8e13d8435a8ed2b814354acb03, user_id=62823bbb5a6c417eadba31f518b830cb, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:23.705814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d41644-5e78-4edb-97c8-12be5af352f5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:23.807838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 932/1838] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:23 2022] PUT /identity/v3/projects/6d4f8a8e13d8435a8ed2b814354acb03/users/62823bbb5a6c417eadba31f518b830cb/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:23.815649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73183013a0a483ba4da39d489dbe6bb', 'request_id': 'req-1063f04d-11d3-456d-985b-576144dc8801'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.819411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5b630-e4ea-480d-b2b9-f649a576dc79 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:23.819727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5b630-e4ea-480d-b2b9-f649a576dc79 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:23.820002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5b630-e4ea-480d-b2b9-f649a576dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:23.846306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-20a5b630-e4ea-480d-b2b9-f649a576dc79 None None] MFA Rules not processed for user `62823bbb5a6c417eadba31f518b830cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:23.847530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-20a5b630-e4ea-480d-b2b9-f649a576dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:23.875707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:23.901981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73183013a0a483ba4da39d489dbe6bb', 'request_id': 'req-1063f04d-11d3-456d-985b-576144dc8801'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.912801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73183013a0a483ba4da39d489dbe6bb', 'request_id': 'req-1063f04d-11d3-456d-985b-576144dc8801'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.918403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 933/1839] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:23.922663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5b630-e4ea-480d-b2b9-f649a576dc79 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:23.926801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] The token cache is being invalidate because project c73183013a0a483ba4da39d489dbe6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:23.927221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.927980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1063f04d-11d3-456d-985b-576144dc8801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:23.933366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 907/1840] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:23 2022] DELETE /identity/v3/projects/c73183013a0a483ba4da39d489dbe6bb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:23.935119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77184c-bc58-4bf9-beb6-0381208c918b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:23.935448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77184c-bc58-4bf9-beb6-0381208c918b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:23.935676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77184c-bc58-4bf9-beb6-0381208c918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:23.954383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5f77184c-bc58-4bf9-beb6-0381208c918b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:23.955590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f77184c-bc58-4bf9-beb6-0381208c918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:23.999111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5b630-e4ea-480d-b2b9-f649a576dc79 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.004630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578e6c6-d221-4ae7-b018-840faf171e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.005640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e6c6-d221-4ae7-b018-840faf171e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.005995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e6c6-d221-4ae7-b018-840faf171e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.006341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e6c6-d221-4ae7-b018-840faf171e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.007181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578e6c6-d221-4ae7-b018-840faf171e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.010138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578e6c6-d221-4ae7-b018-840faf171e36 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.011956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:24.019820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 908/1841] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:24.027903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec0213-5ff0-4b36-a1b9-111ca2421e54 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.028199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec0213-5ff0-4b36-a1b9-111ca2421e54 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.028524 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec0213-5ff0-4b36-a1b9-111ca2421e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.047410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-07ec0213-5ff0-4b36-a1b9-111ca2421e54 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:24.048656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-07ec0213-5ff0-4b36-a1b9-111ca2421e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:24.061174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 909/1842] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:24.062415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec0213-5ff0-4b36-a1b9-111ca2421e54 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.073248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec0213-5ff0-4b36-a1b9-111ca2421e54 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.078951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61998407-0f4d-4323-898b-e93f5122cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.079583 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61998407-0f4d-4323-898b-e93f5122cefd admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.079876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61998407-0f4d-4323-898b-e93f5122cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.080153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61998407-0f4d-4323-898b-e93f5122cefd admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.080919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61998407-0f4d-4323-898b-e93f5122cefd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:24.083887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61998407-0f4d-4323-898b-e93f5122cefd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.083887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61998407-0f4d-4323-898b-e93f5122cefd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.090690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 934/1843] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:23 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:24.091566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578e6c6-d221-4ae7-b018-840faf171e36 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.099214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 910/1844] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:24.099397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0578e6c6-d221-4ae7-b018-840faf171e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:24.101265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61998407-0f4d-4323-898b-e93f5122cefd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.113390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61998407-0f4d-4323-898b-e93f5122cefd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.185292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17b743-f7d9-4bfd-8847-cdef3aed351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.186241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17b743-f7d9-4bfd-8847-cdef3aed351e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.187226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17b743-f7d9-4bfd-8847-cdef3aed351e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.187606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17b743-f7d9-4bfd-8847-cdef3aed351e admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.188464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17b743-f7d9-4bfd-8847-cdef3aed351e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.190836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17b743-f7d9-4bfd-8847-cdef3aed351e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.213683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578e6c6-d221-4ae7-b018-840faf171e36 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.219223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527eab7-cb0b-4b77-9712-de916e284506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.220019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527eab7-cb0b-4b77-9712-de916e284506 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.220479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527eab7-cb0b-4b77-9712-de916e284506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.220945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527eab7-cb0b-4b77-9712-de916e284506 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.221758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527eab7-cb0b-4b77-9712-de916e284506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.223898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527eab7-cb0b-4b77-9712-de916e284506 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.228443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:24.338378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 911/1845] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:24 2022] POST /identity/v3/projects => generated 361 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:24.355215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 935/1846] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:24 2022] POST /identity/v3/users => generated 300 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:24.356368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17b743-f7d9-4bfd-8847-cdef3aed351e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.357353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527eab7-cb0b-4b77-9712-de916e284506 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.370148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527eab7-cb0b-4b77-9712-de916e284506 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.459434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17b743-f7d9-4bfd-8847-cdef3aed351e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.465465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd33f1-ece1-4e87-929d-78162aa3b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.470173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd33f1-ece1-4e87-929d-78162aa3b35c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.470173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd33f1-ece1-4e87-929d-78162aa3b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.470173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd33f1-ece1-4e87-929d-78162aa3b35c admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.470427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c257bb0-ee7a-497f-a57b-f22c5693c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.470539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd33f1-ece1-4e87-929d-78162aa3b35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.470623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c257bb0-ee7a-497f-a57b-f22c5693c0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.470623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c257bb0-ee7a-497f-a57b-f22c5693c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.470623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c257bb0-ee7a-497f-a57b-f22c5693c0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.470834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd33f1-ece1-4e87-929d-78162aa3b35c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.470927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c257bb0-ee7a-497f-a57b-f22c5693c0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.472512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c257bb0-ee7a-497f-a57b-f22c5693c0f1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.484788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 936/1847] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:24.487851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c257bb0-ee7a-497f-a57b-f22c5693c0f1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.498296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c257bb0-ee7a-497f-a57b-f22c5693c0f1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.505889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0880-f474-46e5-b8b5-83a036f41e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.507092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0880-f474-46e5-b8b5-83a036f41e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.507466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0880-f474-46e5-b8b5-83a036f41e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.508437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0880-f474-46e5-b8b5-83a036f41e5b admin admin] PATH_INFO: `/v3/projects/e0a2f98609d6439bb3865fe63a82c1bb/users/6e4d0bde72c14328846557ef924b390e/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.533298 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0880-f474-46e5-b8b5-83a036f41e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a2f98609d6439bb3865fe63a82c1bb, user_id=6e4d0bde72c14328846557ef924b390e, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.544220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a0880-f474-46e5-b8b5-83a036f41e5b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.556372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 912/1848] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:24 2022] POST /identity/v3/users => generated 281 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:24.559547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd33f1-ece1-4e87-929d-78162aa3b35c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.571163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd33f1-ece1-4e87-929d-78162aa3b35c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.576146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046529-7822-4555-b7b3-006dd13f5685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.576936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046529-7822-4555-b7b3-006dd13f5685 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.577224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046529-7822-4555-b7b3-006dd13f5685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.577498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046529-7822-4555-b7b3-006dd13f5685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.578221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046529-7822-4555-b7b3-006dd13f5685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.579808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046529-7822-4555-b7b3-006dd13f5685 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.593038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 913/1849] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:24.593853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046529-7822-4555-b7b3-006dd13f5685 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.603199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046529-7822-4555-b7b3-006dd13f5685 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.607774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e9b3e-6146-4cd7-9299-6f886cf222b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.608426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9b3e-6146-4cd7-9299-6f886cf222b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.608712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9b3e-6146-4cd7-9299-6f886cf222b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.608991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9b3e-6146-4cd7-9299-6f886cf222b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.609690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e9b3e-6146-4cd7-9299-6f886cf222b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.611261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e9b3e-6146-4cd7-9299-6f886cf222b3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.621777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 914/1850] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:24.626890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e9b3e-6146-4cd7-9299-6f886cf222b3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.640900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e9b3e-6146-4cd7-9299-6f886cf222b3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.651347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225fdca-cb88-4d9d-b21b-38468694ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.653920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225fdca-cb88-4d9d-b21b-38468694ff20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.654496 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225fdca-cb88-4d9d-b21b-38468694ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.655042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225fdca-cb88-4d9d-b21b-38468694ff20 admin admin] PATH_INFO: `/v3/projects/353d9fc85b244989854656d9936f3a1f/users/d0fa679a405845389a693ae1590d06c1/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.670530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:24.678665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 937/1851] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:24 2022] PUT /identity/v3/projects/e0a2f98609d6439bb3865fe63a82c1bb/users/6e4d0bde72c14328846557ef924b390e/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:24.683411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0880-f474-46e5-b8b5-83a036f41e5b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.702757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225fdca-cb88-4d9d-b21b-38468694ff20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353d9fc85b244989854656d9936f3a1f, user_id=d0fa679a405845389a693ae1590d06c1, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.710126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225fdca-cb88-4d9d-b21b-38468694ff20 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.790281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a0880-f474-46e5-b8b5-83a036f41e5b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.801281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3957537-272f-4fe9-ac85-9290e0df8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.801968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3957537-272f-4fe9-ac85-9290e0df8aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.802249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3957537-272f-4fe9-ac85-9290e0df8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.802528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3957537-272f-4fe9-ac85-9290e0df8aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.803506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3957537-272f-4fe9-ac85-9290e0df8aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.806015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3957537-272f-4fe9-ac85-9290e0df8aa0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:24.817839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 915/1852] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:24 2022] PUT /identity/v3/projects/353d9fc85b244989854656d9936f3a1f/users/d0fa679a405845389a693ae1590d06c1/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:24.821769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 938/1853] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:24.828271 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225fdca-cb88-4d9d-b21b-38468694ff20 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:24.830873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec42770-b0d2-4816-ad9b-cb43d5774767 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.832147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec42770-b0d2-4816-ad9b-cb43d5774767 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.832755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec42770-b0d2-4816-ad9b-cb43d5774767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.871526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bec42770-b0d2-4816-ad9b-cb43d5774767 None None] MFA Rules not processed for user `d0fa679a405845389a693ae1590d06c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:24.872926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bec42770-b0d2-4816-ad9b-cb43d5774767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:24.921969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225fdca-cb88-4d9d-b21b-38468694ff20 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:24.956353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac6234-87c2-4904-9f52-0a53f1603504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:24.960485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac6234-87c2-4904-9f52-0a53f1603504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:24.960485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac6234-87c2-4904-9f52-0a53f1603504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:24.960485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac6234-87c2-4904-9f52-0a53f1603504 admin admin] PATH_INFO: `/v3/projects/e0a2f98609d6439bb3865fe63a82c1bb/users/6e4d0bde72c14328846557ef924b390e/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:24.964640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac6234-87c2-4904-9f52-0a53f1603504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a2f98609d6439bb3865fe63a82c1bb, user_id=6e4d0bde72c14328846557ef924b390e, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:24.978452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac6234-87c2-4904-9f52-0a53f1603504 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:25.001207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 939/1854] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:25.002458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 916/1855] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:24 2022] PUT /identity/v3/projects/e0a2f98609d6439bb3865fe63a82c1bb/users/6e4d0bde72c14328846557ef924b390e/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:25.013626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b15e01-ba4d-4397-874d-7d5e177d5e7f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:25.014438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b15e01-ba4d-4397-874d-7d5e177d5e7f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:25.015257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b15e01-ba4d-4397-874d-7d5e177d5e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:25.062580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-54b15e01-ba4d-4397-874d-7d5e177d5e7f None None] MFA Rules not processed for user `6e4d0bde72c14328846557ef924b390e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:25.063847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-54b15e01-ba4d-4397-874d-7d5e177d5e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:25.078215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac6234-87c2-4904-9f52-0a53f1603504 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:25.081391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-22ac6234-87c2-4904-9f52-0a53f1603504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:25.159642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac6234-87c2-4904-9f52-0a53f1603504 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:25.166407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278bf0-ce18-411d-895d-5cc2a5ea0f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:25.167069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278bf0-ce18-411d-895d-5cc2a5ea0f57 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:25.167351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278bf0-ce18-411d-895d-5cc2a5ea0f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:25.167630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278bf0-ce18-411d-895d-5cc2a5ea0f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:25.171328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 940/1856] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:25.227316 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278bf0-ce18-411d-895d-5cc2a5ea0f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:25.228785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278bf0-ce18-411d-895d-5cc2a5ea0f57 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:25.238201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 917/1857] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:23:25.254367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b15e01-ba4d-4397-874d-7d5e177d5e7f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:25.269445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278bf0-ce18-411d-895d-5cc2a5ea0f57 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:25.275719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:25.296545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278bf0-ce18-411d-895d-5cc2a5ea0f57 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:25.312437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196bcd-84ca-4ab9-928c-9ec5fe7a95a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:25.313107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196bcd-84ca-4ab9-928c-9ec5fe7a95a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:25.313393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196bcd-84ca-4ab9-928c-9ec5fe7a95a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:25.313670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196bcd-84ca-4ab9-928c-9ec5fe7a95a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:25.362126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196bcd-84ca-4ab9-928c-9ec5fe7a95a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:25.363831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196bcd-84ca-4ab9-928c-9ec5fe7a95a5 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:25.366404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b15e01-ba4d-4397-874d-7d5e177d5e7f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:25.375546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:25.377410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:25.377703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:25.378028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] PATH_INFO: `/v3/users/d0fa679a405845389a693ae1590d06c1` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:25.380584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0fa679a405845389a693ae1590d06c1)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:25.383830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 918/1858] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:25.383976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:25.672221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0fa679a405845389a693ae1590d06c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:25.673783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0fa679a405845389a693ae1590d06c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:25.692786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0fa679a405845389a693ae1590d06c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:25.694249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0fa679a405845389a693ae1590d06c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:25.727796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0fa679a405845389a693ae1590d06c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:25.829859 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 941/1859] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:25 2022] DELETE /identity/v3/users/d0fa679a405845389a693ae1590d06c1 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:25.834491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a1c86-2230-4373-9973-102072f46e64 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:25.834914 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a1c86-2230-4373-9973-102072f46e64 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:25.835274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a1c86-2230-4373-9973-102072f46e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:25.880648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f06a1c86-2230-4373-9973-102072f46e64 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:25.882319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f06a1c86-2230-4373-9973-102072f46e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:25.902851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:26.035778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 919/1860] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:26.045247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:26.046771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:26.163465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8e0ae-af55-417e-9b26-210a7c13eafb admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:26.167530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09896-7082-445d-a596-9a55fb0cc1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:26.168176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09896-7082-445d-a596-9a55fb0cc1cb service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:26.168497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09896-7082-445d-a596-9a55fb0cc1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:26.168774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09896-7082-445d-a596-9a55fb0cc1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:26.178434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e09896-7082-445d-a596-9a55fb0cc1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:26.180763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e09896-7082-445d-a596-9a55fb0cc1cb service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:26.196543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 942/1861] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:26.813083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a1c86-2230-4373-9973-102072f46e64 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:26.815026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f06a1c86-2230-4373-9973-102072f46e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:26.841400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a1c86-2230-4373-9973-102072f46e64 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:26.845911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:26.846769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:26.847012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:26.847288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] PATH_INFO: `/v3/projects/353d9fc85b244989854656d9936f3a1f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:26.850303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=353d9fc85b244989854656d9936f3a1f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:26.852854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:26.884664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:26.884769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733fd1a-469e-4dc2-b574-bea7cb48383f None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:26.884769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733fd1a-469e-4dc2-b574-bea7cb48383f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:26.884769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733fd1a-469e-4dc2-b574-bea7cb48383f None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:26.885365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 943/1862] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:23:26.900729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595b264-0cbd-4f01-a9e2-962efa546302 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:26.901026 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595b264-0cbd-4f01-a9e2-962efa546302 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:26.901526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595b264-0cbd-4f01-a9e2-962efa546302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:26.937145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5595b264-0cbd-4f01-a9e2-962efa546302 None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:26.938376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5595b264-0cbd-4f01-a9e2-962efa546302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:27.010313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353d9fc85b244989854656d9936f3a1f', 'request_id': 'req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:27.042214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 944/1863] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:23:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:27.058356 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353d9fc85b244989854656d9936f3a1f', 'request_id': 'req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:27.071460 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353d9fc85b244989854656d9936f3a1f', 'request_id': 'req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:27.098550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595b264-0cbd-4f01-a9e2-962efa546302 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:27.100617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5595b264-0cbd-4f01-a9e2-962efa546302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:27.103258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] The token cache is being invalidate because project 353d9fc85b244989854656d9936f3a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:27.103844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:27.104788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-192693b6-6215-4b28-9ce2-0ed8a0cd50a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:27.107099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 920/1864] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:26 2022] DELETE /identity/v3/projects/353d9fc85b244989854656d9936f3a1f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:27.112157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65989c-31c6-45b3-8b21-5aac9c1bc6ba None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.112513 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65989c-31c6-45b3-8b21-5aac9c1bc6ba None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.112801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65989c-31c6-45b3-8b21-5aac9c1bc6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.130036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595b264-0cbd-4f01-a9e2-962efa546302 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:27.145540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fb65989c-31c6-45b3-8b21-5aac9c1bc6ba None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:27.147113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fb65989c-31c6-45b3-8b21-5aac9c1bc6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:27.249871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611ca66-7fe5-41e9-b6f5-89d8170f865f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:27.250813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611ca66-7fe5-41e9-b6f5-89d8170f865f service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.251424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611ca66-7fe5-41e9-b6f5-89d8170f865f service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.251712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611ca66-7fe5-41e9-b6f5-89d8170f865f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.253585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7611ca66-7fe5-41e9-b6f5-89d8170f865f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:27.260179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 921/1865] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:27.261434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65989c-31c6-45b3-8b21-5aac9c1bc6ba None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:27.266714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fb65989c-31c6-45b3-8b21-5aac9c1bc6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:27.270781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611ca66-7fe5-41e9-b6f5-89d8170f865f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:27.272582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611ca66-7fe5-41e9-b6f5-89d8170f865f service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:27.285267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 945/1866] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:27.286820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbec61f-63cd-438a-9396-f9dd2b22607f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.287118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbec61f-63cd-438a-9396-f9dd2b22607f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.287449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbec61f-63cd-438a-9396-f9dd2b22607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.323772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1cbec61f-63cd-438a-9396-f9dd2b22607f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:27.323772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1cbec61f-63cd-438a-9396-f9dd2b22607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:27.329493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 946/1867] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:27.334069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbec61f-63cd-438a-9396-f9dd2b22607f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:27.343064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:27.347455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbec61f-63cd-438a-9396-f9dd2b22607f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:27.354243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950054e-cf9b-4e6e-ba75-3e5cab06c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:27.355658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950054e-cf9b-4e6e-ba75-3e5cab06c15e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.355957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950054e-cf9b-4e6e-ba75-3e5cab06c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.356239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950054e-cf9b-4e6e-ba75-3e5cab06c15e admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.357396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950054e-cf9b-4e6e-ba75-3e5cab06c15e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:27.357799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950054e-cf9b-4e6e-ba75-3e5cab06c15e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:27.359701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950054e-cf9b-4e6e-ba75-3e5cab06c15e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:27.359825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65989c-31c6-45b3-8b21-5aac9c1bc6ba None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:27.364053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38951a6e-cbab-4e01-865e-759ce710ce49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:27.364944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38951a6e-cbab-4e01-865e-759ce710ce49 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.365449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38951a6e-cbab-4e01-865e-759ce710ce49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.365848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38951a6e-cbab-4e01-865e-759ce710ce49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.368771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-38951a6e-cbab-4e01-865e-759ce710ce49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:27.378062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 947/1868] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:27.382155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950054e-cf9b-4e6e-ba75-3e5cab06c15e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:27.401189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950054e-cf9b-4e6e-ba75-3e5cab06c15e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:27.408368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255af60-3616-4acf-bfc0-9c37c190f216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:27.409344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255af60-3616-4acf-bfc0-9c37c190f216 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.409939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255af60-3616-4acf-bfc0-9c37c190f216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.410432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255af60-3616-4acf-bfc0-9c37c190f216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.411996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255af60-3616-4acf-bfc0-9c37c190f216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:27.414644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255af60-3616-4acf-bfc0-9c37c190f216 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:27.456116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38951a6e-cbab-4e01-865e-759ce710ce49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:27.457625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38951a6e-cbab-4e01-865e-759ce710ce49 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:27.475157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 922/1869] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:27.516980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 948/1870] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:27 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:27.521611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38951a6e-cbab-4e01-865e-759ce710ce49 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:27.533798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38951a6e-cbab-4e01-865e-759ce710ce49 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:27.618304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9113-37b1-4671-a2a3-f39a2424fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:27.619135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9113-37b1-4671-a2a3-f39a2424fe01 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.619479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9113-37b1-4671-a2a3-f39a2424fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.619848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9113-37b1-4671-a2a3-f39a2424fe01 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.620666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed9113-37b1-4671-a2a3-f39a2424fe01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:27.622651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed9113-37b1-4671-a2a3-f39a2424fe01 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:27.738703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255af60-3616-4acf-bfc0-9c37c190f216 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:27.740564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b255af60-3616-4acf-bfc0-9c37c190f216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:27.752879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255af60-3616-4acf-bfc0-9c37c190f216 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:27.757666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:27.758539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.758854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.759133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] PATH_INFO: `/v3/users/992cbe3b739c410eb17ea546e919a071` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.760506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=992cbe3b739c410eb17ea546e919a071)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:27.763166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:27.769087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 923/1871] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:27 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:27.770350 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9113-37b1-4671-a2a3-f39a2424fe01 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:27.784498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9113-37b1-4671-a2a3-f39a2424fe01 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:27.794571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b8a4-85d4-4812-99e5-d3582783fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:27.795252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b8a4-85d4-4812-99e5-d3582783fc52 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.800259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b8a4-85d4-4812-99e5-d3582783fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.800639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b8a4-85d4-4812-99e5-d3582783fc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.801461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185b8a4-85d4-4812-99e5-d3582783fc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:27.803136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185b8a4-85d4-4812-99e5-d3582783fc52 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:27.817638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 924/1872] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:27.818728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b8a4-85d4-4812-99e5-d3582783fc52 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:27.829572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b8a4-85d4-4812-99e5-d3582783fc52 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:27.834124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d828213-315b-41d6-a280-3c9e7f6385c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:27.842929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d828213-315b-41d6-a280-3c9e7f6385c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.842929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d828213-315b-41d6-a280-3c9e7f6385c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.842929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d828213-315b-41d6-a280-3c9e7f6385c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.842929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d828213-315b-41d6-a280-3c9e7f6385c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:27.842929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d828213-315b-41d6-a280-3c9e7f6385c9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:27.851246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 925/1873] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:27.852257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d828213-315b-41d6-a280-3c9e7f6385c9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:27.866233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d828213-315b-41d6-a280-3c9e7f6385c9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:27.868242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a0916-85ff-4728-9040-5e7549850e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:27.869158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a0916-85ff-4728-9040-5e7549850e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.869440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a0916-85ff-4728-9040-5e7549850e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.869713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a0916-85ff-4728-9040-5e7549850e13 admin admin] PATH_INFO: `/v3/projects/7a7e0ac9b8b245b194bdc1c1a3051a65/users/35876b46d2054a2e911a72253ea40f1c/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.885986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a0916-85ff-4728-9040-5e7549850e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7e0ac9b8b245b194bdc1c1a3051a65, user_id=35876b46d2054a2e911a72253ea40f1c, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:27.888787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a0916-85ff-4728-9040-5e7549850e13 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:27.968163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 926/1874] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:27 2022] PUT /identity/v3/projects/7a7e0ac9b8b245b194bdc1c1a3051a65/users/35876b46d2054a2e911a72253ea40f1c/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:27.978228 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc361a-81e1-459d-9391-194e355f7de1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:27.978658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc361a-81e1-459d-9391-194e355f7de1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:27.979085 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc361a-81e1-459d-9391-194e355f7de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:27.984875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '992cbe3b739c410eb17ea546e919a071'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:27.985742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '992cbe3b739c410eb17ea546e919a071'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:27.992799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '992cbe3b739c410eb17ea546e919a071'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:27.993579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '992cbe3b739c410eb17ea546e919a071'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:28.005495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a7cc361a-81e1-459d-9391-194e355f7de1 None None] MFA Rules not processed for user `35876b46d2054a2e911a72253ea40f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:28.006023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e817d0b-3c00-4af1-beed-0d218b208479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '992cbe3b739c410eb17ea546e919a071'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:28.006868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a7cc361a-81e1-459d-9391-194e355f7de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:28.068436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 949/1875] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:27 2022] DELETE /identity/v3/users/992cbe3b739c410eb17ea546e919a071 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:28.072172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d96ea-5016-4da0-90bb-c488af794934 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:28.072508 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d96ea-5016-4da0-90bb-c488af794934 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:28.072814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d96ea-5016-4da0-90bb-c488af794934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:28.085540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 927/1876] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:28.085540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc361a-81e1-459d-9391-194e355f7de1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:28.085540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a7cc361a-81e1-459d-9391-194e355f7de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:28.092980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-594d96ea-5016-4da0-90bb-c488af794934 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:28.094153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-594d96ea-5016-4da0-90bb-c488af794934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:28.192647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc361a-81e1-459d-9391-194e355f7de1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:28.212895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 950/1877] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:28.220432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d96ea-5016-4da0-90bb-c488af794934 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:28.222046 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-594d96ea-5016-4da0-90bb-c488af794934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:28.273230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c965087-a4be-4b90-8811-3ff17123aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:28.275708 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965087-a4be-4b90-8811-3ff17123aac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:28.276416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965087-a4be-4b90-8811-3ff17123aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:28.276904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965087-a4be-4b90-8811-3ff17123aac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:28.277811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c965087-a4be-4b90-8811-3ff17123aac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:28.280303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c965087-a4be-4b90-8811-3ff17123aac9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:28.312754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d96ea-5016-4da0-90bb-c488af794934 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:28.324082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ff9b7-54de-4227-8767-bec599965007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:28.325108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ff9b7-54de-4227-8767-bec599965007 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:28.325659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ff9b7-54de-4227-8767-bec599965007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:28.326133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ff9b7-54de-4227-8767-bec599965007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:28.342039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ff9b7-54de-4227-8767-bec599965007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:28.344207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ff9b7-54de-4227-8767-bec599965007 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:28.359961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 951/1878] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:28.360261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:28.363425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ff9b7-54de-4227-8767-bec599965007 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:28.363425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-374ff9b7-54de-4227-8767-bec599965007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:28.381437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ff9b7-54de-4227-8767-bec599965007 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:28.387394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:28.388302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:28.388602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:28.388874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] PATH_INFO: `/v3/users/58d528d148304c26a9a9473695956d5e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:28.390620 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d528d148304c26a9a9473695956d5e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:28.392796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:28.413301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 928/1879] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:28 2022] POST /identity/v3/projects => generated 385 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:28.417219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c965087-a4be-4b90-8811-3ff17123aac9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:28.491376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:28.530155 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c965087-a4be-4b90-8811-3ff17123aac9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:28.541223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833376cb-e83b-4e1a-96c3-ea4f1d7dec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:28.541958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833376cb-e83b-4e1a-96c3-ea4f1d7dec68 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:28.542361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833376cb-e83b-4e1a-96c3-ea4f1d7dec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:28.544183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833376cb-e83b-4e1a-96c3-ea4f1d7dec68 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:28.544183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833376cb-e83b-4e1a-96c3-ea4f1d7dec68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:28.546480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833376cb-e83b-4e1a-96c3-ea4f1d7dec68 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:28.676971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 929/1880] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:28 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:28.679287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833376cb-e83b-4e1a-96c3-ea4f1d7dec68 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:28.693355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d528d148304c26a9a9473695956d5e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:28.694843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d528d148304c26a9a9473695956d5e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:28.704154 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d528d148304c26a9a9473695956d5e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:28.704955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d528d148304c26a9a9473695956d5e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:28.709764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833376cb-e83b-4e1a-96c3-ea4f1d7dec68 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:28.714970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d5e3-b5bf-4ac2-87f1-88b6c538e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:28.716476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d5e3-b5bf-4ac2-87f1-88b6c538e992 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:28.716476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d5e3-b5bf-4ac2-87f1-88b6c538e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:28.716849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d5e3-b5bf-4ac2-87f1-88b6c538e992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:28.717678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6d5e3-b5bf-4ac2-87f1-88b6c538e992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:28.720075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6d5e3-b5bf-4ac2-87f1-88b6c538e992 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:28.720238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5942d755-99df-44c6-ab2d-6e0401e6d040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d528d148304c26a9a9473695956d5e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:28.744820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 930/1881] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:28.746061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d5e3-b5bf-4ac2-87f1-88b6c538e992 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:28.747840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9ff6d5e3-b5bf-4ac2-87f1-88b6c538e992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:28.763715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d5e3-b5bf-4ac2-87f1-88b6c538e992 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:28.777319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4696-1cf4-4444-8290-871a25a08fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:28.777319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4696-1cf4-4444-8290-871a25a08fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:28.777319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4696-1cf4-4444-8290-871a25a08fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:28.777319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4696-1cf4-4444-8290-871a25a08fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:28.780133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d4696-1cf4-4444-8290-871a25a08fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:28.780133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d4696-1cf4-4444-8290-871a25a08fb7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:28.808240 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 931/1882] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:28.812670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4696-1cf4-4444-8290-871a25a08fb7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:28.824497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4696-1cf4-4444-8290-871a25a08fb7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:28.837002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 952/1883] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:28 2022] DELETE /identity/v3/users/58d528d148304c26a9a9473695956d5e => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:28.843304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98168-4608-4b6e-a2ae-35972691d3df None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:28.843607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98168-4608-4b6e-a2ae-35972691d3df None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:28.844354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98168-4608-4b6e-a2ae-35972691d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:28.857165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32276b-ad82-4318-b25b-d6adbbcdaf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:28.858088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32276b-ad82-4318-b25b-d6adbbcdaf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:28.858377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32276b-ad82-4318-b25b-d6adbbcdaf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:28.858647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32276b-ad82-4318-b25b-d6adbbcdaf72 admin admin] PATH_INFO: `/v3/projects/644535e7be234242b9456545372394ad/users/605f2f16550d4d7eb94c026421c4fc3b/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:28.878007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-22a98168-4608-4b6e-a2ae-35972691d3df None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:28.879549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-22a98168-4608-4b6e-a2ae-35972691d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:28.886921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32276b-ad82-4318-b25b-d6adbbcdaf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644535e7be234242b9456545372394ad, user_id=605f2f16550d4d7eb94c026421c4fc3b, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:28.892424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32276b-ad82-4318-b25b-d6adbbcdaf72 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:28.950775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 953/1884] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:28.973108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98168-4608-4b6e-a2ae-35972691d3df None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:28.977884 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-22a98168-4608-4b6e-a2ae-35972691d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:29.007250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 932/1885] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:28 2022] PUT /identity/v3/projects/644535e7be234242b9456545372394ad/users/605f2f16550d4d7eb94c026421c4fc3b/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:29.017653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68147ee-f862-4f05-b033-9ea7b0a1679b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:29.018040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68147ee-f862-4f05-b033-9ea7b0a1679b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:29.018376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68147ee-f862-4f05-b033-9ea7b0a1679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:29.047343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a68147ee-f862-4f05-b033-9ea7b0a1679b None None] MFA Rules not processed for user `605f2f16550d4d7eb94c026421c4fc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:29.048770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a68147ee-f862-4f05-b033-9ea7b0a1679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:29.054251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98168-4608-4b6e-a2ae-35972691d3df None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:29.107361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36cb65-ade2-4258-bf68-243ba0619b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:29.108038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36cb65-ade2-4258-bf68-243ba0619b40 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:29.108341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36cb65-ade2-4258-bf68-243ba0619b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:29.108638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36cb65-ade2-4258-bf68-243ba0619b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:29.116640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 933/1886] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:29.125269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68147ee-f862-4f05-b033-9ea7b0a1679b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:29.182457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36cb65-ade2-4258-bf68-243ba0619b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:29.184007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36cb65-ade2-4258-bf68-243ba0619b40 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:29.195728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 954/1887] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:29.196723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36cb65-ade2-4258-bf68-243ba0619b40 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:29.199039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-de36cb65-ade2-4258-bf68-243ba0619b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:29.212273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36cb65-ade2-4258-bf68-243ba0619b40 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:29.217451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:29.218310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:29.218657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:29.218931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] PATH_INFO: `/v3/projects/0918ca53ca95411cafa1df1711e62970` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:29.220747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=0918ca53ca95411cafa1df1711e62970)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:29.225450 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:29.236840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68147ee-f862-4f05-b033-9ea7b0a1679b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:29.244822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cd1d9-45e7-4a15-abf3-ee60b18717ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:29.245906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cd1d9-45e7-4a15-abf3-ee60b18717ee admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:29.247862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cd1d9-45e7-4a15-abf3-ee60b18717ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:29.248253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cd1d9-45e7-4a15-abf3-ee60b18717ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:29.254036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cd1d9-45e7-4a15-abf3-ee60b18717ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:29.254036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cd1d9-45e7-4a15-abf3-ee60b18717ee admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:29.398374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 934/1888] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:29 2022] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:29.402789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0918ca53ca95411cafa1df1711e62970', 'request_id': 'req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:29.404046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cd1d9-45e7-4a15-abf3-ee60b18717ee admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:29.497541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0918ca53ca95411cafa1df1711e62970', 'request_id': 'req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:29.512944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0918ca53ca95411cafa1df1711e62970', 'request_id': 'req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:29.537409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] The token cache is being invalidate because project 0918ca53ca95411cafa1df1711e62970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:29.537828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:29.538694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:29.548270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 955/1889] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:29 2022] DELETE /identity/v3/projects/0918ca53ca95411cafa1df1711e62970 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:29.549410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:29.551187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:29.584612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cd1d9-45e7-4a15-abf3-ee60b18717ee admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:29.593245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e1178-210c-4b4d-94e3-1a48ab40d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:29.594339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e1178-210c-4b4d-94e3-1a48ab40d1ae admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:29.595639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e1178-210c-4b4d-94e3-1a48ab40d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:29.596104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e1178-210c-4b4d-94e3-1a48ab40d1ae admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:29.598532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e1178-210c-4b4d-94e3-1a48ab40d1ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:29.602081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e1178-210c-4b4d-94e3-1a48ab40d1ae admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:29.754418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 935/1890] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:29 2022] POST /identity/v3/users => generated 299 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:29.758988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e1178-210c-4b4d-94e3-1a48ab40d1ae admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:29.761589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-247e1178-210c-4b4d-94e3-1a48ab40d1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:29.771141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9c9ef-0258-4af6-bbc4-65929ce33eae admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:29.779974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:29.782214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:29.795697 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:29.795697 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] PATH_INFO: `/v3/users/6f5ec209bd55457a82fea3c8dcf55f32` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:29.796189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e1178-210c-4b4d-94e3-1a48ab40d1ae admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:29.797244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5ec209bd55457a82fea3c8dcf55f32)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:29.799144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:29.807392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97355aa-7831-4fe8-b61f-ddb120bfb1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:29.810393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97355aa-7831-4fe8-b61f-ddb120bfb1da admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:29.810393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97355aa-7831-4fe8-b61f-ddb120bfb1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:29.813046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97355aa-7831-4fe8-b61f-ddb120bfb1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:29.814183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97355aa-7831-4fe8-b61f-ddb120bfb1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:29.819559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97355aa-7831-4fe8-b61f-ddb120bfb1da admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:29.842079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 936/1891] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:29.848395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97355aa-7831-4fe8-b61f-ddb120bfb1da admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:29.864548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97355aa-7831-4fe8-b61f-ddb120bfb1da admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:29.870453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0a0c5-f88d-4678-a48a-aa7b08e8d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:29.871672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0a0c5-f88d-4678-a48a-aa7b08e8d6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:29.871963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0a0c5-f88d-4678-a48a-aa7b08e8d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:29.872234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0a0c5-f88d-4678-a48a-aa7b08e8d6ba admin admin] PATH_INFO: `/v3/projects/af2b0a00bf0945f7aa695e47cf15360b/users/c0f199cd9ed044a09aa64ddf6949ba9a/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:29.897388 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0a0c5-f88d-4678-a48a-aa7b08e8d6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2b0a00bf0945f7aa695e47cf15360b, user_id=c0f199cd9ed044a09aa64ddf6949ba9a, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:29.901265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0a0c5-f88d-4678-a48a-aa7b08e8d6ba admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:29.983371 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 937/1892] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:29 2022] PUT /identity/v3/projects/af2b0a00bf0945f7aa695e47cf15360b/users/c0f199cd9ed044a09aa64ddf6949ba9a/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:29.987097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0a0c5-f88d-4678-a48a-aa7b08e8d6ba admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:30.054442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0a0c5-f88d-4678-a48a-aa7b08e8d6ba admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:30.060212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05ab6-bedb-44db-9c6f-9db185206c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:30.060970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05ab6-bedb-44db-9c6f-9db185206c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:30.061263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05ab6-bedb-44db-9c6f-9db185206c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:30.065146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05ab6-bedb-44db-9c6f-9db185206c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:30.065146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a05ab6-bedb-44db-9c6f-9db185206c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:30.065146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a05ab6-bedb-44db-9c6f-9db185206c4f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:30.080035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 938/1893] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:30.081053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05ab6-bedb-44db-9c6f-9db185206c4f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:30.086828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5ec209bd55457a82fea3c8dcf55f32'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.087490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5ec209bd55457a82fea3c8dcf55f32'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.090950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05ab6-bedb-44db-9c6f-9db185206c4f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:30.094467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5ec209bd55457a82fea3c8dcf55f32'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.095099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5ec209bd55457a82fea3c8dcf55f32'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.095913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb26cf-51dd-4af1-9c2e-381965f6da06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:30.096876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb26cf-51dd-4af1-9c2e-381965f6da06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:30.097159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb26cf-51dd-4af1-9c2e-381965f6da06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:30.097436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb26cf-51dd-4af1-9c2e-381965f6da06 admin admin] PATH_INFO: `/v3/projects/af2b0a00bf0945f7aa695e47cf15360b/users/c0f199cd9ed044a09aa64ddf6949ba9a/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:30.099403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb26cf-51dd-4af1-9c2e-381965f6da06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2b0a00bf0945f7aa695e47cf15360b, user_id=c0f199cd9ed044a09aa64ddf6949ba9a, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:30.102770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb26cf-51dd-4af1-9c2e-381965f6da06 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:30.107437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5ec209bd55457a82fea3c8dcf55f32'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.112841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 939/1894] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:30 2022] PUT /identity/v3/projects/af2b0a00bf0945f7aa695e47cf15360b/users/c0f199cd9ed044a09aa64ddf6949ba9a/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:30.125077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3210bba-4ec8-4638-963c-4a353ba02670 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:30.125287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3210bba-4ec8-4638-963c-4a353ba02670 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:30.125565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3210bba-4ec8-4638-963c-4a353ba02670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:30.165188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a3210bba-4ec8-4638-963c-4a353ba02670 None None] MFA Rules not processed for user `c0f199cd9ed044a09aa64ddf6949ba9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:30.167232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a3210bba-4ec8-4638-963c-4a353ba02670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:30.177462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 956/1895] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:29 2022] DELETE /identity/v3/users/6f5ec209bd55457a82fea3c8dcf55f32 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:30.191109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:30.193439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:30.297568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 940/1896] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:30.310090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3210bba-4ec8-4638-963c-4a353ba02670 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:30.312649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a3210bba-4ec8-4638-963c-4a353ba02670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:30.319335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbd6f6-75bd-4004-aea6-bf110f495349 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:30.325059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:30.326240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:30.326522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:30.326796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] PATH_INFO: `/v3/projects/0ce20bd80ca34990a40e22ee8d96b080` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:30.328606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce20bd80ca34990a40e22ee8d96b080)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:30.330689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:30.372374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:30.400263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3210bba-4ec8-4638-963c-4a353ba02670 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:30.448847 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9390a0-8869-4f2c-bab1-4c13f5d04446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:30.449863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9390a0-8869-4f2c-bab1-4c13f5d04446 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:30.450150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9390a0-8869-4f2c-bab1-4c13f5d04446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:30.450431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9390a0-8869-4f2c-bab1-4c13f5d04446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:30.452529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4c9390a0-8869-4f2c-bab1-4c13f5d04446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:30.505776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce20bd80ca34990a40e22ee8d96b080', 'request_id': 'req-7aab604f-7ae2-4108-997a-0ecf9752f2b7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.541113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9390a0-8869-4f2c-bab1-4c13f5d04446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:30.542636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9390a0-8869-4f2c-bab1-4c13f5d04446 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:30.562229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 941/1897] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:30.581854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce20bd80ca34990a40e22ee8d96b080', 'request_id': 'req-7aab604f-7ae2-4108-997a-0ecf9752f2b7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.588647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce20bd80ca34990a40e22ee8d96b080', 'request_id': 'req-7aab604f-7ae2-4108-997a-0ecf9752f2b7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.615692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] The token cache is being invalidate because project 0ce20bd80ca34990a40e22ee8d96b080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:30.621095 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.625013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:30.630085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 957/1898] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:30 2022] DELETE /identity/v3/projects/0ce20bd80ca34990a40e22ee8d96b080 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:30.633968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9390a0-8869-4f2c-bab1-4c13f5d04446 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:30.651535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9390a0-8869-4f2c-bab1-4c13f5d04446 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:30.705418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:30.802630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:30.803469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:30.807172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:30.807416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] PATH_INFO: `/v3/users/1fbda474c4dd4c158b4ea93df20a2d8a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:30.808814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbda474c4dd4c158b4ea93df20a2d8a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:30.811115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:30.872972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:30.874373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:30.889777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab604f-7ae2-4108-997a-0ecf9752f2b7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:30.893423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:30.894700 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:30.895288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:30.895288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] PATH_INFO: `/v3/projects/34b88a850ca54ce992810fd589942ff9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:30.896923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b88a850ca54ce992810fd589942ff9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:30.908133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:31.144601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbda474c4dd4c158b4ea93df20a2d8a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.150531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b88a850ca54ce992810fd589942ff9', 'request_id': 'req-42ed463c-acd7-4b29-b7c7-2c5501bfb890'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.152037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbda474c4dd4c158b4ea93df20a2d8a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.153008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbda474c4dd4c158b4ea93df20a2d8a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.166785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbda474c4dd4c158b4ea93df20a2d8a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.262792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b88a850ca54ce992810fd589942ff9', 'request_id': 'req-42ed463c-acd7-4b29-b7c7-2c5501bfb890'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.271947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b88a850ca54ce992810fd589942ff9', 'request_id': 'req-42ed463c-acd7-4b29-b7c7-2c5501bfb890'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.286515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] The token cache is being invalidate because project 34b88a850ca54ce992810fd589942ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:31.287073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.287801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-42ed463c-acd7-4b29-b7c7-2c5501bfb890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.292458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 958/1899] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:30 2022] DELETE /identity/v3/projects/34b88a850ca54ce992810fd589942ff9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:31.294926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8d16-7d7f-4b47-a376-c0ebd72d3bda None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:31.295323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8d16-7d7f-4b47-a376-c0ebd72d3bda None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:31.296024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8d16-7d7f-4b47-a376-c0ebd72d3bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:31.314788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-95dc8d16-7d7f-4b47-a376-c0ebd72d3bda None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:31.316052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-95dc8d16-7d7f-4b47-a376-c0ebd72d3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:31.375513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 959/1900] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:31.383033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963af9-8c95-45e8-af09-b2104bf5d858 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:31.383327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963af9-8c95-45e8-af09-b2104bf5d858 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:31.383607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963af9-8c95-45e8-af09-b2104bf5d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:31.387072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbda474c4dd4c158b4ea93df20a2d8a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:31.395550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 942/1901] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:30 2022] DELETE /identity/v3/users/1fbda474c4dd4c158b4ea93df20a2d8a => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:31.410751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bd963af9-8c95-45e8-af09-b2104bf5d858 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:31.411902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bd963af9-8c95-45e8-af09-b2104bf5d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:31.473616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 960/1902] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:31.478644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:31.488689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b870b3-40eb-41fa-b872-48781ded6e9a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:31.493456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af230e4-14e8-4d69-a236-679b2cd07c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:31.494152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af230e4-14e8-4d69-a236-679b2cd07c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:31.494442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af230e4-14e8-4d69-a236-679b2cd07c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:31.494723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af230e4-14e8-4d69-a236-679b2cd07c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:31.495449 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af230e4-14e8-4d69-a236-679b2cd07c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:31.495759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af230e4-14e8-4d69-a236-679b2cd07c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:31.497414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af230e4-14e8-4d69-a236-679b2cd07c55 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:31.509025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 943/1903] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:31.513272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd963af9-8c95-45e8-af09-b2104bf5d858 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:31.522440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd963af9-8c95-45e8-af09-b2104bf5d858 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:31.527871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ade5a4-2109-4179-a589-2b2019c4d99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:31.528569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ade5a4-2109-4179-a589-2b2019c4d99d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:31.528922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ade5a4-2109-4179-a589-2b2019c4d99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:31.529620 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ade5a4-2109-4179-a589-2b2019c4d99d admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:31.530347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ade5a4-2109-4179-a589-2b2019c4d99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:31.532605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ade5a4-2109-4179-a589-2b2019c4d99d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:31.666580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 961/1904] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:31 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:31.670913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af230e4-14e8-4d69-a236-679b2cd07c55 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:31.681244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af230e4-14e8-4d69-a236-679b2cd07c55 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:31.773028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc170a-2870-461c-9cfa-7a656759ab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:31.774370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc170a-2870-461c-9cfa-7a656759ab44 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:31.774712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc170a-2870-461c-9cfa-7a656759ab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:31.775486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc170a-2870-461c-9cfa-7a656759ab44 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:31.775885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc170a-2870-461c-9cfa-7a656759ab44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:31.777968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc170a-2870-461c-9cfa-7a656759ab44 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:31.829721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ade5a4-2109-4179-a589-2b2019c4d99d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:31.831529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b1ade5a4-2109-4179-a589-2b2019c4d99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:31.852498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ade5a4-2109-4179-a589-2b2019c4d99d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:31.861247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:31.861247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:31.861247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:31.861247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] PATH_INFO: `/v3/projects/0083de7427f84a3ebabbf96ae2abac19` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:31.861839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0083de7427f84a3ebabbf96ae2abac19)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:31.862738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:31.910076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 944/1905] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:31 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:31.914090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc170a-2870-461c-9cfa-7a656759ab44 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:31.926655 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc170a-2870-461c-9cfa-7a656759ab44 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:31.932754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165bdf-17fa-48a2-afaf-e77c3d4ad91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:31.933808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165bdf-17fa-48a2-afaf-e77c3d4ad91b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:31.934110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165bdf-17fa-48a2-afaf-e77c3d4ad91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:31.935809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1165bdf-17fa-48a2-afaf-e77c3d4ad91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:31.936650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165bdf-17fa-48a2-afaf-e77c3d4ad91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:31.941471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1165bdf-17fa-48a2-afaf-e77c3d4ad91b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:31.953761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 945/1906] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:31.954872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165bdf-17fa-48a2-afaf-e77c3d4ad91b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:31.967614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1165bdf-17fa-48a2-afaf-e77c3d4ad91b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:31.981813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0083de7427f84a3ebabbf96ae2abac19', 'request_id': 'req-aa8c4e91-d56d-4a86-a693-16bc87a26995'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:32.035079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1a8dd-5092-4660-835f-2fc148105f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.036149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1a8dd-5092-4660-835f-2fc148105f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.036646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1a8dd-5092-4660-835f-2fc148105f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.036924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1a8dd-5092-4660-835f-2fc148105f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.037731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1a8dd-5092-4660-835f-2fc148105f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.039446 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1a8dd-5092-4660-835f-2fc148105f87 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.049364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 946/1907] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:32.053375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1a8dd-5092-4660-835f-2fc148105f87 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.065415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1a8dd-5092-4660-835f-2fc148105f87 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.070361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66692c0-6254-4394-b8da-8fb433fb064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.071784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66692c0-6254-4394-b8da-8fb433fb064f admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.072097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66692c0-6254-4394-b8da-8fb433fb064f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.072412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66692c0-6254-4394-b8da-8fb433fb064f admin admin] PATH_INFO: `/v3/projects/07c8f7ba18c3473cae525be58d4c2eab/users/7dc0dc485c1547238155fde12c565fa4/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.086550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0083de7427f84a3ebabbf96ae2abac19', 'request_id': 'req-aa8c4e91-d56d-4a86-a693-16bc87a26995'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:32.088694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66692c0-6254-4394-b8da-8fb433fb064f admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c8f7ba18c3473cae525be58d4c2eab, user_id=7dc0dc485c1547238155fde12c565fa4, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.091532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66692c0-6254-4394-b8da-8fb433fb064f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.097411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0083de7427f84a3ebabbf96ae2abac19', 'request_id': 'req-aa8c4e91-d56d-4a86-a693-16bc87a26995'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:32.111091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] The token cache is being invalidate because project 0083de7427f84a3ebabbf96ae2abac19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:32.111384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:32.112060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-aa8c4e91-d56d-4a86-a693-16bc87a26995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:32.113810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 962/1908] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:31 2022] DELETE /identity/v3/projects/0083de7427f84a3ebabbf96ae2abac19 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:32.119072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f28838-4116-452e-ac43-d39f3c9ba7e7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.119458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f28838-4116-452e-ac43-d39f3c9ba7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.119749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f28838-4116-452e-ac43-d39f3c9ba7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.138723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c3f28838-4116-452e-ac43-d39f3c9ba7e7 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:32.139933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c3f28838-4116-452e-ac43-d39f3c9ba7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:32.148437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 963/1909] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:32.159462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d377da-453c-4dd5-b7e0-244db6e2ffc9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.160055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d377da-453c-4dd5-b7e0-244db6e2ffc9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.160055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d377da-453c-4dd5-b7e0-244db6e2ffc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.160511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 947/1910] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:32 2022] PUT /identity/v3/projects/07c8f7ba18c3473cae525be58d4c2eab/users/7dc0dc485c1547238155fde12c565fa4/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:32.178972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efceb1-00f8-43aa-86e0-843781f7152f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.178972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efceb1-00f8-43aa-86e0-843781f7152f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.178972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efceb1-00f8-43aa-86e0-843781f7152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.190992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c2d377da-453c-4dd5-b7e0-244db6e2ffc9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:32.192211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c2d377da-453c-4dd5-b7e0-244db6e2ffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:32.209620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-49efceb1-00f8-43aa-86e0-843781f7152f None None] MFA Rules not processed for user `7dc0dc485c1547238155fde12c565fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:32.210856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-49efceb1-00f8-43aa-86e0-843781f7152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:32.255408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 964/1911] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:32.260338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d377da-453c-4dd5-b7e0-244db6e2ffc9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.269629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d377da-453c-4dd5-b7e0-244db6e2ffc9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.275465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3891-a8db-4407-b1e9-a90ccf9b28da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.276231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3891-a8db-4407-b1e9-a90ccf9b28da admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.276449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3891-a8db-4407-b1e9-a90ccf9b28da admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.276731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3891-a8db-4407-b1e9-a90ccf9b28da admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.277462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3891-a8db-4407-b1e9-a90ccf9b28da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:32.277767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3891-a8db-4407-b1e9-a90ccf9b28da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.279365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3891-a8db-4407-b1e9-a90ccf9b28da admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.285258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 948/1912] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:32.290158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efceb1-00f8-43aa-86e0-843781f7152f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.291664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-49efceb1-00f8-43aa-86e0-843781f7152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:32.295645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 965/1913] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:23:32.296698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3891-a8db-4407-b1e9-a90ccf9b28da admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.308338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efceb1-00f8-43aa-86e0-843781f7152f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.315578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87b355-0828-4be0-9a13-bef532722585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.316422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87b355-0828-4be0-9a13-bef532722585 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.316783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87b355-0828-4be0-9a13-bef532722585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.317184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87b355-0828-4be0-9a13-bef532722585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.318018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87b355-0828-4be0-9a13-bef532722585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.318674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3891-a8db-4407-b1e9-a90ccf9b28da admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.320132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87b355-0828-4be0-9a13-bef532722585 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.324897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51675e-7026-45e8-ba6a-27385129f17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.325627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51675e-7026-45e8-ba6a-27385129f17d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.325911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51675e-7026-45e8-ba6a-27385129f17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.326247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51675e-7026-45e8-ba6a-27385129f17d admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.326951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51675e-7026-45e8-ba6a-27385129f17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.329657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51675e-7026-45e8-ba6a-27385129f17d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.493864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 949/1914] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:32 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:32.502455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87b355-0828-4be0-9a13-bef532722585 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.502558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 966/1915] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:32 2022] POST /identity/v3/projects => generated 391 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:32.503224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51675e-7026-45e8-ba6a-27385129f17d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.589554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51675e-7026-45e8-ba6a-27385129f17d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.605265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8665bc6-9c80-440b-98a6-fb9c07f8ff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.605958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8665bc6-9c80-440b-98a6-fb9c07f8ff0d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.606245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8665bc6-9c80-440b-98a6-fb9c07f8ff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.606525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8665bc6-9c80-440b-98a6-fb9c07f8ff0d admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.607129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87b355-0828-4be0-9a13-bef532722585 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.607243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8665bc6-9c80-440b-98a6-fb9c07f8ff0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.609316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8665bc6-9c80-440b-98a6-fb9c07f8ff0d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.614221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebcb05-5eab-423b-b433-de9f9c6fa57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.614950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebcb05-5eab-423b-b433-de9f9c6fa57d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.615241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebcb05-5eab-423b-b433-de9f9c6fa57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.615518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebcb05-5eab-423b-b433-de9f9c6fa57d admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.618334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebcb05-5eab-423b-b433-de9f9c6fa57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.622123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebcb05-5eab-423b-b433-de9f9c6fa57d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.697274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 950/1916] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:32 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:32.697465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 967/1917] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:32 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:32.699070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8665bc6-9c80-440b-98a6-fb9c07f8ff0d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.699935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebcb05-5eab-423b-b433-de9f9c6fa57d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.712861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8665bc6-9c80-440b-98a6-fb9c07f8ff0d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.714186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebcb05-5eab-423b-b433-de9f9c6fa57d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.715641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd485e3-10d1-4243-9db7-5ba3a55da196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.716414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd485e3-10d1-4243-9db7-5ba3a55da196 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.716775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd485e3-10d1-4243-9db7-5ba3a55da196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.717120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd485e3-10d1-4243-9db7-5ba3a55da196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.717949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd485e3-10d1-4243-9db7-5ba3a55da196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.719692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f05ca-1bac-4f96-8f98-d368dac9c6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.719831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd485e3-10d1-4243-9db7-5ba3a55da196 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.720191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f05ca-1bac-4f96-8f98-d368dac9c6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.720559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f05ca-1bac-4f96-8f98-d368dac9c6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.721038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f05ca-1bac-4f96-8f98-d368dac9c6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.721771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f05ca-1bac-4f96-8f98-d368dac9c6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.723541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f05ca-1bac-4f96-8f98-d368dac9c6a1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.730661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 968/1918] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:32.734557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd485e3-10d1-4243-9db7-5ba3a55da196 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.740584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 951/1919] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:32.741605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f05ca-1bac-4f96-8f98-d368dac9c6a1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.745586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd485e3-10d1-4243-9db7-5ba3a55da196 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.750469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75136dd-c87c-4e72-853a-fdc34fd73a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.751151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75136dd-c87c-4e72-853a-fdc34fd73a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.751695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75136dd-c87c-4e72-853a-fdc34fd73a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.754266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f05ca-1bac-4f96-8f98-d368dac9c6a1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.758120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75136dd-c87c-4e72-853a-fdc34fd73a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.758728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75136dd-c87c-4e72-853a-fdc34fd73a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.764377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75136dd-c87c-4e72-853a-fdc34fd73a81 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.766077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19621fa6-5ac5-47c2-af40-a7153d8eb5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.767028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19621fa6-5ac5-47c2-af40-a7153d8eb5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.767317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19621fa6-5ac5-47c2-af40-a7153d8eb5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.767601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19621fa6-5ac5-47c2-af40-a7153d8eb5c6 admin admin] PATH_INFO: `/v3/projects/0638fb5a72cf4f9c815fd2bc956b7ae1/users/70c49430170244c29643f9c428c3a0e1/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.780240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 969/1920] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:32.788267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75136dd-c87c-4e72-853a-fdc34fd73a81 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.796735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19621fa6-5ac5-47c2-af40-a7153d8eb5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0638fb5a72cf4f9c815fd2bc956b7ae1, user_id=70c49430170244c29643f9c428c3a0e1, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.799079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19621fa6-5ac5-47c2-af40-a7153d8eb5c6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.815961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75136dd-c87c-4e72-853a-fdc34fd73a81 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.828839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91093a-fddd-4223-b5eb-395349ef92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:32.829928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91093a-fddd-4223-b5eb-395349ef92ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:32.830375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91093a-fddd-4223-b5eb-395349ef92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:32.830663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91093a-fddd-4223-b5eb-395349ef92ff admin admin] PATH_INFO: `/v3/projects/0ebf182ad3f74bf9974ed76ca189b67a/users/ff2aaf6cf5114ef8bccef7b57d65a501/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:32.858416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91093a-fddd-4223-b5eb-395349ef92ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebf182ad3f74bf9974ed76ca189b67a, user_id=ff2aaf6cf5114ef8bccef7b57d65a501, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:32.861271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91093a-fddd-4223-b5eb-395349ef92ff admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:32.910283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:32.916911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 952/1921] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:32 2022] PUT /identity/v3/projects/0638fb5a72cf4f9c815fd2bc956b7ae1/users/70c49430170244c29643f9c428c3a0e1/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:32.920876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19621fa6-5ac5-47c2-af40-a7153d8eb5c6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:32.985071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19621fa6-5ac5-47c2-af40-a7153d8eb5c6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:32.990410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 970/1922] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:32 2022] PUT /identity/v3/projects/0ebf182ad3f74bf9974ed76ca189b67a/users/ff2aaf6cf5114ef8bccef7b57d65a501/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:33.000656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2b9f-9d3d-4f50-8113-4f2e87c668ac None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.001016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2b9f-9d3d-4f50-8113-4f2e87c668ac None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.001412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2b9f-9d3d-4f50-8113-4f2e87c668ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.030451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-fc7e2b9f-9d3d-4f50-8113-4f2e87c668ac None None] MFA Rules not processed for user `ff2aaf6cf5114ef8bccef7b57d65a501`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:33.031755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fc7e2b9f-9d3d-4f50-8113-4f2e87c668ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:33.043828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cccab1-49b9-4cfd-9d2f-e0e72c58e912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.044439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cccab1-49b9-4cfd-9d2f-e0e72c58e912 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.044730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cccab1-49b9-4cfd-9d2f-e0e72c58e912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.045005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cccab1-49b9-4cfd-9d2f-e0e72c58e912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.048990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cccab1-49b9-4cfd-9d2f-e0e72c58e912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.048990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cccab1-49b9-4cfd-9d2f-e0e72c58e912 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.057157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 953/1923] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:33.061388 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cccab1-49b9-4cfd-9d2f-e0e72c58e912 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:33.072264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cccab1-49b9-4cfd-9d2f-e0e72c58e912 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:33.077883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dcd91-d42a-45e6-984f-97bad409d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.078765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dcd91-d42a-45e6-984f-97bad409d3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.079325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dcd91-d42a-45e6-984f-97bad409d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.079474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dcd91-d42a-45e6-984f-97bad409d3a2 admin admin] PATH_INFO: `/v3/projects/0638fb5a72cf4f9c815fd2bc956b7ae1/users/70c49430170244c29643f9c428c3a0e1/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.081678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dcd91-d42a-45e6-984f-97bad409d3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0638fb5a72cf4f9c815fd2bc956b7ae1, user_id=70c49430170244c29643f9c428c3a0e1, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.084738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dcd91-d42a-45e6-984f-97bad409d3a2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.096745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 954/1924] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:33 2022] PUT /identity/v3/projects/0638fb5a72cf4f9c815fd2bc956b7ae1/users/70c49430170244c29643f9c428c3a0e1/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:33.105407 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 971/1925] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:33.112055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dcd91-d42a-45e6-984f-97bad409d3a2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:33.112879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7860-e54e-467a-861c-ebb32785787b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.113224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7860-e54e-467a-861c-ebb32785787b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.113562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7860-e54e-467a-861c-ebb32785787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.142553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b4ab7860-e54e-467a-861c-ebb32785787b None None] MFA Rules not processed for user `70c49430170244c29643f9c428c3a0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:33.143961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b4ab7860-e54e-467a-861c-ebb32785787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:33.179223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dcd91-d42a-45e6-984f-97bad409d3a2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:33.184521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2dae-e9a9-4451-af5d-94c19c90a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.185331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2dae-e9a9-4451-af5d-94c19c90a753 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.185612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2dae-e9a9-4451-af5d-94c19c90a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.186120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2dae-e9a9-4451-af5d-94c19c90a753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.186623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2dae-e9a9-4451-af5d-94c19c90a753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.188834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2dae-e9a9-4451-af5d-94c19c90a753 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.220658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 972/1926] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:33.221503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7860-e54e-467a-861c-ebb32785787b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:33.222766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b4ab7860-e54e-467a-861c-ebb32785787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:33.264451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 955/1927] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:33 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:33.265409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2dae-e9a9-4451-af5d-94c19c90a753 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:33.266987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-90ac2dae-e9a9-4451-af5d-94c19c90a753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:33.281263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7860-e54e-467a-861c-ebb32785787b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:33.286167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:33.323610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2dae-e9a9-4451-af5d-94c19c90a753 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:33.327484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8b579-6313-4613-9cf4-a577c1593c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.328153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8b579-6313-4613-9cf4-a577c1593c85 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.328608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8b579-6313-4613-9cf4-a577c1593c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.328891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8b579-6313-4613-9cf4-a577c1593c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.330686 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c226436-c54c-4659-a840-e6d475bd142e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.330916 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-54f8b579-6313-4613-9cf4-a577c1593c85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:33.331340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c226436-c54c-4659-a840-e6d475bd142e service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.331629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c226436-c54c-4659-a840-e6d475bd142e service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.331912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c226436-c54c-4659-a840-e6d475bd142e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.333719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7c226436-c54c-4659-a840-e6d475bd142e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:33.390045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8b579-6313-4613-9cf4-a577c1593c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.391242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c226436-c54c-4659-a840-e6d475bd142e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.391602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8b579-6313-4613-9cf4-a577c1593c85 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.392718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c226436-c54c-4659-a840-e6d475bd142e service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.401607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 956/1928] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:33.402395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8b579-6313-4613-9cf4-a577c1593c85 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:33.402658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 973/1929] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:33.470822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8b579-6313-4613-9cf4-a577c1593c85 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:33.476301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8866-3d29-410a-8624-93c085c64171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.476956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8866-3d29-410a-8624-93c085c64171 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.477878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8866-3d29-410a-8624-93c085c64171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.477878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8866-3d29-410a-8624-93c085c64171 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.478413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8866-3d29-410a-8624-93c085c64171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.480543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8866-3d29-410a-8624-93c085c64171 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.590544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 957/1930] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:33 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:33.594632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c226436-c54c-4659-a840-e6d475bd142e service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:33.606038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c226436-c54c-4659-a840-e6d475bd142e service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:33.611294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8912e19-4baf-43e0-9070-706e7cd89164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.617597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8912e19-4baf-43e0-9070-706e7cd89164 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.617597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8912e19-4baf-43e0-9070-706e7cd89164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.617597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8912e19-4baf-43e0-9070-706e7cd89164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.617597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8912e19-4baf-43e0-9070-706e7cd89164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.617597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8912e19-4baf-43e0-9070-706e7cd89164 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.630910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 974/1931] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:33.632642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8866-3d29-410a-8624-93c085c64171 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:33.644853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8866-3d29-410a-8624-93c085c64171 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:33.650412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9d859-ddc1-4f55-941b-7ae3c041475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.651422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9d859-ddc1-4f55-941b-7ae3c041475e admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.651799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9d859-ddc1-4f55-941b-7ae3c041475e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.652174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9d859-ddc1-4f55-941b-7ae3c041475e admin admin] PATH_INFO: `/v3/projects/11e19de3f7b641bb9f40139f0fd1f129/users/ce537b7f004641cfb3e4c50a12a71ee6/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.667822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9d859-ddc1-4f55-941b-7ae3c041475e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e19de3f7b641bb9f40139f0fd1f129, user_id=ce537b7f004641cfb3e4c50a12a71ee6, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.670633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9d859-ddc1-4f55-941b-7ae3c041475e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.812530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 958/1932] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:33 2022] PUT /identity/v3/projects/11e19de3f7b641bb9f40139f0fd1f129/users/ce537b7f004641cfb3e4c50a12a71ee6/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:33.816441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8912e19-4baf-43e0-9070-706e7cd89164 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:33.827063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8912e19-4baf-43e0-9070-706e7cd89164 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:33.896768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aa7fd-0b8b-400f-9e4a-78215a9c565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.897551 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa7fd-0b8b-400f-9e4a-78215a9c565a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.897832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa7fd-0b8b-400f-9e4a-78215a9c565a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.898109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa7fd-0b8b-400f-9e4a-78215a9c565a admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.898866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aa7fd-0b8b-400f-9e4a-78215a9c565a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.900565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aa7fd-0b8b-400f-9e4a-78215a9c565a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.910475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 975/1933] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:33.915318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9d859-ddc1-4f55-941b-7ae3c041475e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:33.925466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9d859-ddc1-4f55-941b-7ae3c041475e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:33.930683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae665b-7f81-4b04-86ec-704faf98a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:33.931544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae665b-7f81-4b04-86ec-704faf98a623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.931825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae665b-7f81-4b04-86ec-704faf98a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.935432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae665b-7f81-4b04-86ec-704faf98a623 admin admin] PATH_INFO: `/v3/projects/11e19de3f7b641bb9f40139f0fd1f129/users/ce537b7f004641cfb3e4c50a12a71ee6/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.935432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae665b-7f81-4b04-86ec-704faf98a623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e19de3f7b641bb9f40139f0fd1f129, user_id=ce537b7f004641cfb3e4c50a12a71ee6, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:33.936704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae665b-7f81-4b04-86ec-704faf98a623 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:33.946813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 959/1934] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:33 2022] PUT /identity/v3/projects/11e19de3f7b641bb9f40139f0fd1f129/users/ce537b7f004641cfb3e4c50a12a71ee6/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:33.957777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e3a0-6e9e-478f-b8fa-e3462c16b977 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:33.958081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e3a0-6e9e-478f-b8fa-e3462c16b977 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:33.958347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e3a0-6e9e-478f-b8fa-e3462c16b977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:33.987672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d000e3a0-6e9e-478f-b8fa-e3462c16b977 None None] MFA Rules not processed for user `ce537b7f004641cfb3e4c50a12a71ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:33.989007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d000e3a0-6e9e-478f-b8fa-e3462c16b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:34.056165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 976/1935] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:35.006441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae665b-7f81-4b04-86ec-704faf98a623 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:35.067412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae665b-7f81-4b04-86ec-704faf98a623 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:35.071031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff39ba-e1ca-439f-8856-f61f973c1208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:35.071766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff39ba-e1ca-439f-8856-f61f973c1208 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:35.072050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff39ba-e1ca-439f-8856-f61f973c1208 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:35.072304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff39ba-e1ca-439f-8856-f61f973c1208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:35.133121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff39ba-e1ca-439f-8856-f61f973c1208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:35.134562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff39ba-e1ca-439f-8856-f61f973c1208 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:35.143755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 960/1936] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:35.172476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e3a0-6e9e-478f-b8fa-e3462c16b977 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:35.243106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e3a0-6e9e-478f-b8fa-e3462c16b977 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:35.247609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:35.248929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:35.249394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:35.249681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] PATH_INFO: `/v3/users/7dc0dc485c1547238155fde12c565fa4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:35.250886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc0dc485c1547238155fde12c565fa4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:35.253149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:35.276030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff39ba-e1ca-439f-8856-f61f973c1208 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:35.287124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff39ba-e1ca-439f-8856-f61f973c1208 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:35.291469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa804f-f0b2-4be6-94c7-805fca842891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:35.292118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa804f-f0b2-4be6-94c7-805fca842891 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:35.292454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa804f-f0b2-4be6-94c7-805fca842891 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:35.292904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa804f-f0b2-4be6-94c7-805fca842891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:35.309125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa804f-f0b2-4be6-94c7-805fca842891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:35.310682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa804f-f0b2-4be6-94c7-805fca842891 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:35.321610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 961/1937] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:23:35.473243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa804f-f0b2-4be6-94c7-805fca842891 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:35.482001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa804f-f0b2-4be6-94c7-805fca842891 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:35.486027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e832616-27dd-4afe-8e64-412cb8c30b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:35.486624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832616-27dd-4afe-8e64-412cb8c30b13 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:35.486907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832616-27dd-4afe-8e64-412cb8c30b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:35.487214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832616-27dd-4afe-8e64-412cb8c30b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:35.490403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc0dc485c1547238155fde12c565fa4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:35.491555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc0dc485c1547238155fde12c565fa4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:35.500526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc0dc485c1547238155fde12c565fa4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:35.501333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc0dc485c1547238155fde12c565fa4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:35.521595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc0dc485c1547238155fde12c565fa4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:35.554689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e832616-27dd-4afe-8e64-412cb8c30b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:35.556138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e832616-27dd-4afe-8e64-412cb8c30b13 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:35.565584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 962/1938] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:23:35.607588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 977/1939] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:35 2022] DELETE /identity/v3/users/7dc0dc485c1547238155fde12c565fa4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:35.612074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6f04c-8d68-4e82-ac0b-38f173d09efc None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:35.612531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6f04c-8d68-4e82-ac0b-38f173d09efc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:35.612940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6f04c-8d68-4e82-ac0b-38f173d09efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:35.631500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0eb6f04c-8d68-4e82-ac0b-38f173d09efc None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:35.633450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0eb6f04c-8d68-4e82-ac0b-38f173d09efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:35.669815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:35.700415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 963/1940] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:35.710332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:35.712021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:35.768648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898aed5d-5740-4a54-b4d0-e33af72d55b0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:35.772297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e7d91-b139-4b9b-9d19-daf336774bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:35.772974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e7d91-b139-4b9b-9d19-daf336774bae service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:35.773259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e7d91-b139-4b9b-9d19-daf336774bae service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:35.773603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e7d91-b139-4b9b-9d19-daf336774bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:35.782725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e7d91-b139-4b9b-9d19-daf336774bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:35.784198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e7d91-b139-4b9b-9d19-daf336774bae service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:35.794567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 978/1941] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:35.834208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:35.862366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6f04c-8d68-4e82-ac0b-38f173d09efc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:35.863751 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0eb6f04c-8d68-4e82-ac0b-38f173d09efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:35.923095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6f04c-8d68-4e82-ac0b-38f173d09efc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:35.926690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa9f8d-5b72-4621-8ca5-51199ef53e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:35.927341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa9f8d-5b72-4621-8ca5-51199ef53e60 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:35.927623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa9f8d-5b72-4621-8ca5-51199ef53e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:35.927900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa9f8d-5b72-4621-8ca5-51199ef53e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:35.930238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b1aa9f8d-5b72-4621-8ca5-51199ef53e60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:36.004775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa9f8d-5b72-4621-8ca5-51199ef53e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:36.006353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa9f8d-5b72-4621-8ca5-51199ef53e60 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:36.017605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 964/1942] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:36.323571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e7d91-b139-4b9b-9d19-daf336774bae service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:36.331820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2a4e7d91-b139-4b9b-9d19-daf336774bae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:36.372623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e7d91-b139-4b9b-9d19-daf336774bae service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:36.393273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:36.396184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:36.396850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:36.397292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] PATH_INFO: `/v3/projects/07c8f7ba18c3473cae525be58d4c2eab` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:36.414646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c8f7ba18c3473cae525be58d4c2eab)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:36.419646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:36.609316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c8f7ba18c3473cae525be58d4c2eab', 'request_id': 'req-91219f08-f126-4f1e-bed6-31c583761a34'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:36.731206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c8f7ba18c3473cae525be58d4c2eab', 'request_id': 'req-91219f08-f126-4f1e-bed6-31c583761a34'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:36.737904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c8f7ba18c3473cae525be58d4c2eab', 'request_id': 'req-91219f08-f126-4f1e-bed6-31c583761a34'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:36.749739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] The token cache is being invalidate because project 07c8f7ba18c3473cae525be58d4c2eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:36.750027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:36.750817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:36.752712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 979/1943] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:36 2022] DELETE /identity/v3/projects/07c8f7ba18c3473cae525be58d4c2eab => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:36.756686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa9f8d-5b72-4621-8ca5-51199ef53e60 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:36.768263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa9f8d-5b72-4621-8ca5-51199ef53e60 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:36.835591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:36.837025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:36.837610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:36.837610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] PATH_INFO: `/v3/users/70c49430170244c29643f9c428c3a0e1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:36.838850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c49430170244c29643f9c428c3a0e1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:36.840814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:37.082237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c49430170244c29643f9c428c3a0e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:37.089842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c49430170244c29643f9c428c3a0e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:37.090514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c49430170244c29643f9c428c3a0e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:37.103201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c49430170244c29643f9c428c3a0e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:37.182589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fcaf30c-2c56-4fbc-ab5a-c8a5bed95836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c49430170244c29643f9c428c3a0e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:37.189474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 965/1944] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:36 2022] DELETE /identity/v3/users/70c49430170244c29643f9c428c3a0e1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:37.291787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:37.371189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:37.697512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:37.699038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:37.713244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91219f08-f126-4f1e-bed6-31c583761a34 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:37.771353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:37.772266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:37.772685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:37.772924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] PATH_INFO: `/v3/projects/0638fb5a72cf4f9c815fd2bc956b7ae1` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:37.774073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0638fb5a72cf4f9c815fd2bc956b7ae1)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:37.776159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:37.907691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0638fb5a72cf4f9c815fd2bc956b7ae1', 'request_id': 'req-d962bf56-747e-4b64-8234-6c208a987aba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:37.994752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0638fb5a72cf4f9c815fd2bc956b7ae1', 'request_id': 'req-d962bf56-747e-4b64-8234-6c208a987aba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:38.000919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0638fb5a72cf4f9c815fd2bc956b7ae1', 'request_id': 'req-d962bf56-747e-4b64-8234-6c208a987aba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:38.012204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] The token cache is being invalidate because project 0638fb5a72cf4f9c815fd2bc956b7ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:38.012520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:38.013161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d962bf56-747e-4b64-8234-6c208a987aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:38.014749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 980/1945] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:37 2022] DELETE /identity/v3/projects/0638fb5a72cf4f9c815fd2bc956b7ae1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:38.019793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd647c4d-90ff-4026-864a-5374f9eb7deb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.020112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd647c4d-90ff-4026-864a-5374f9eb7deb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.020429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd647c4d-90ff-4026-864a-5374f9eb7deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.041252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-cd647c4d-90ff-4026-864a-5374f9eb7deb None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:38.042440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cd647c4d-90ff-4026-864a-5374f9eb7deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:38.100371 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 966/1946] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:38.108596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc0b44-c801-4917-a276-f880e4ad9633 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.108888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc0b44-c801-4917-a276-f880e4ad9633 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.109218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc0b44-c801-4917-a276-f880e4ad9633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.128049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-42dc0b44-c801-4917-a276-f880e4ad9633 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:38.129303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-42dc0b44-c801-4917-a276-f880e4ad9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:38.140968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 981/1947] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:38.142667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd647c4d-90ff-4026-864a-5374f9eb7deb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:38.153031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd647c4d-90ff-4026-864a-5374f9eb7deb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:38.158851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218c0ac-53ec-4285-97d4-b323f34be67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:38.159522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c0ac-53ec-4285-97d4-b323f34be67a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.159809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c0ac-53ec-4285-97d4-b323f34be67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.160088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c0ac-53ec-4285-97d4-b323f34be67a admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.160854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218c0ac-53ec-4285-97d4-b323f34be67a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:38.161164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218c0ac-53ec-4285-97d4-b323f34be67a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:38.162816 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218c0ac-53ec-4285-97d4-b323f34be67a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:38.176050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 967/1948] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:38.180520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc0b44-c801-4917-a276-f880e4ad9633 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:38.197218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc0b44-c801-4917-a276-f880e4ad9633 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:38.197218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c47e0-573a-47db-8631-ae5091c2db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:38.197218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c47e0-573a-47db-8631-ae5091c2db75 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.197218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c47e0-573a-47db-8631-ae5091c2db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.197532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c47e0-573a-47db-8631-ae5091c2db75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.197532 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c47e0-573a-47db-8631-ae5091c2db75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:38.198721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c47e0-573a-47db-8631-ae5091c2db75 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:38.274678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 982/1949] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:38 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:38.279662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218c0ac-53ec-4285-97d4-b323f34be67a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:38.290303 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218c0ac-53ec-4285-97d4-b323f34be67a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:38.358857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139896d-28df-41b8-b3e5-e1dd3f5e9f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:38.359625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139896d-28df-41b8-b3e5-e1dd3f5e9f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.359997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139896d-28df-41b8-b3e5-e1dd3f5e9f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.360409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139896d-28df-41b8-b3e5-e1dd3f5e9f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.361229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139896d-28df-41b8-b3e5-e1dd3f5e9f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:38.363325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139896d-28df-41b8-b3e5-e1dd3f5e9f6a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:38.463014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 968/1950] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:38 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:38.467019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c47e0-573a-47db-8631-ae5091c2db75 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:38.478013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c47e0-573a-47db-8631-ae5091c2db75 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:38.482780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fd009-f0ab-4ab1-93b3-3dff5a4b0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:38.487719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd009-f0ab-4ab1-93b3-3dff5a4b0a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.487719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd009-f0ab-4ab1-93b3-3dff5a4b0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.487719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd009-f0ab-4ab1-93b3-3dff5a4b0a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.487719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fd009-f0ab-4ab1-93b3-3dff5a4b0a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:38.487719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fd009-f0ab-4ab1-93b3-3dff5a4b0a9c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:38.505934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 983/1951] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:38.506027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139896d-28df-41b8-b3e5-e1dd3f5e9f6a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:38.536080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139896d-28df-41b8-b3e5-e1dd3f5e9f6a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:38.543648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114224b5-fcac-44cf-a9c0-7f4bc7fef607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:38.545105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114224b5-fcac-44cf-a9c0-7f4bc7fef607 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.545105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114224b5-fcac-44cf-a9c0-7f4bc7fef607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.545281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114224b5-fcac-44cf-a9c0-7f4bc7fef607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.546013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114224b5-fcac-44cf-a9c0-7f4bc7fef607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:38.547719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114224b5-fcac-44cf-a9c0-7f4bc7fef607 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:38.561292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 969/1952] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:38.565522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fd009-f0ab-4ab1-93b3-3dff5a4b0a9c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:38.589509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fd009-f0ab-4ab1-93b3-3dff5a4b0a9c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:38.600947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5106-c31e-49a8-81ea-728715accec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:38.601908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5106-c31e-49a8-81ea-728715accec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.602192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5106-c31e-49a8-81ea-728715accec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.602469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5106-c31e-49a8-81ea-728715accec2 admin admin] PATH_INFO: `/v3/projects/20efd385fdab48afbe83bd9c46d43a05/users/ae41c7a1eb7c40349058e08091a663a5/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.628057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5106-c31e-49a8-81ea-728715accec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20efd385fdab48afbe83bd9c46d43a05, user_id=ae41c7a1eb7c40349058e08091a663a5, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:38.630534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5106-c31e-49a8-81ea-728715accec2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:38.766228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 984/1953] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:38 2022] PUT /identity/v3/projects/20efd385fdab48afbe83bd9c46d43a05/users/ae41c7a1eb7c40349058e08091a663a5/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:38.777527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47699df-2237-4586-a443-f6ef7ca7da66 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.777850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47699df-2237-4586-a443-f6ef7ca7da66 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.778157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47699df-2237-4586-a443-f6ef7ca7da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.810489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d47699df-2237-4586-a443-f6ef7ca7da66 None None] MFA Rules not processed for user `ae41c7a1eb7c40349058e08091a663a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:38.811724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d47699df-2237-4586-a443-f6ef7ca7da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:38.864702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:38.878329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 970/1954] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:38.882679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5106-c31e-49a8-81ea-728715accec2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:38.951595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5106-c31e-49a8-81ea-728715accec2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:38.952594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c9bbd-09e6-40f1-8d22-c5f429baef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:38.953253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c9bbd-09e6-40f1-8d22-c5f429baef7b admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:38.953537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c9bbd-09e6-40f1-8d22-c5f429baef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:38.953813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c9bbd-09e6-40f1-8d22-c5f429baef7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:38.954628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c9bbd-09e6-40f1-8d22-c5f429baef7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:38.956942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c9bbd-09e6-40f1-8d22-c5f429baef7b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:39.089617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 985/1955] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:38 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:39.093517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47699df-2237-4586-a443-f6ef7ca7da66 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:39.126863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47699df-2237-4586-a443-f6ef7ca7da66 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:39.214951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42719-9449-431e-819b-5d4667fa075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:39.216371 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42719-9449-431e-819b-5d4667fa075a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:39.216927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42719-9449-431e-819b-5d4667fa075a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:39.217404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42719-9449-431e-819b-5d4667fa075a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:39.218299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a42719-9449-431e-819b-5d4667fa075a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:39.221099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a42719-9449-431e-819b-5d4667fa075a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:39.309270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 971/1956] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:39 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:39.313287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c9bbd-09e6-40f1-8d22-c5f429baef7b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:39.326268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c9bbd-09e6-40f1-8d22-c5f429baef7b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:39.337165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2369-d7e3-413b-83e4-c113d4c63b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:39.338067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2369-d7e3-413b-83e4-c113d4c63b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:39.340589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2369-d7e3-413b-83e4-c113d4c63b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:39.342000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2369-d7e3-413b-83e4-c113d4c63b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:39.344578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f2369-d7e3-413b-83e4-c113d4c63b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:39.347900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f2369-d7e3-413b-83e4-c113d4c63b17 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:39.377661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 986/1957] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:39.381927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42719-9449-431e-819b-5d4667fa075a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:39.395026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42719-9449-431e-819b-5d4667fa075a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:39.401360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82f6e1-d7cf-403b-9e78-0b8da43d41b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:39.402433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f6e1-d7cf-403b-9e78-0b8da43d41b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:39.402960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f6e1-d7cf-403b-9e78-0b8da43d41b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:39.403729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f6e1-d7cf-403b-9e78-0b8da43d41b9 admin admin] PATH_INFO: `/v3/projects/4dd4e6aa1fab47d0856c05dcc4efd7c7/users/59e50b0a8f874c58aaaad225a0397682/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:39.419422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82f6e1-d7cf-403b-9e78-0b8da43d41b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd4e6aa1fab47d0856c05dcc4efd7c7, user_id=59e50b0a8f874c58aaaad225a0397682, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:39.422149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82f6e1-d7cf-403b-9e78-0b8da43d41b9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:39.451063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:39.503106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 972/1958] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:39 2022] PUT /identity/v3/projects/4dd4e6aa1fab47d0856c05dcc4efd7c7/users/59e50b0a8f874c58aaaad225a0397682/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:39.507183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2369-d7e3-413b-83e4-c113d4c63b17 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:39.518300 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2369-d7e3-413b-83e4-c113d4c63b17 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:39.596042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2bf2c-a191-4eb6-9565-b83ff91c4a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:39.596788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2bf2c-a191-4eb6-9565-b83ff91c4a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:39.597370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2bf2c-a191-4eb6-9565-b83ff91c4a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:39.597583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2bf2c-a191-4eb6-9565-b83ff91c4a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:39.598311 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2bf2c-a191-4eb6-9565-b83ff91c4a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:39.599908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2bf2c-a191-4eb6-9565-b83ff91c4a72 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:39.610605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 987/1959] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:39.614935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82f6e1-d7cf-403b-9e78-0b8da43d41b9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:39.625436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82f6e1-d7cf-403b-9e78-0b8da43d41b9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:39.630544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995b96-076c-4650-b53b-e6af60817104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:39.631455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995b96-076c-4650-b53b-e6af60817104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:39.631734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995b96-076c-4650-b53b-e6af60817104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:39.632007 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995b96-076c-4650-b53b-e6af60817104 admin admin] PATH_INFO: `/v3/projects/4dd4e6aa1fab47d0856c05dcc4efd7c7/users/59e50b0a8f874c58aaaad225a0397682/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:39.634073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16995b96-076c-4650-b53b-e6af60817104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd4e6aa1fab47d0856c05dcc4efd7c7, user_id=59e50b0a8f874c58aaaad225a0397682, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:39.636787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16995b96-076c-4650-b53b-e6af60817104 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:39.646888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 973/1960] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:39 2022] PUT /identity/v3/projects/4dd4e6aa1fab47d0856c05dcc4efd7c7/users/59e50b0a8f874c58aaaad225a0397682/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:39.657522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5b710-4711-4742-83ef-bffb1764433f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:39.657811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5b710-4711-4742-83ef-bffb1764433f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:39.658087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5b710-4711-4742-83ef-bffb1764433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:39.684931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-45a5b710-4711-4742-83ef-bffb1764433f None None] MFA Rules not processed for user `59e50b0a8f874c58aaaad225a0397682`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:39.686270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-45a5b710-4711-4742-83ef-bffb1764433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:39.760789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 988/1961] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:39.822954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995b96-076c-4650-b53b-e6af60817104 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:39.824838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16995b96-076c-4650-b53b-e6af60817104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:39.871846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5b710-4711-4742-83ef-bffb1764433f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:39.873520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-45a5b710-4711-4742-83ef-bffb1764433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:39.920023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995b96-076c-4650-b53b-e6af60817104 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:39.925273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:39.926275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:39.926796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:39.927149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] PATH_INFO: `/v3/users/e15012a2a0e444aaa2238ab7e15d955f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:39.928762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15012a2a0e444aaa2238ab7e15d955f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:39.931241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:39.983405 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5b710-4711-4742-83ef-bffb1764433f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:39.987887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a83fc-419b-4cbd-8be8-8af564696211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:39.988976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a83fc-419b-4cbd-8be8-8af564696211 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:39.989270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a83fc-419b-4cbd-8be8-8af564696211 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:39.989364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:39.989554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a83fc-419b-4cbd-8be8-8af564696211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:40.055211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a83fc-419b-4cbd-8be8-8af564696211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:40.056744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a83fc-419b-4cbd-8be8-8af564696211 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:40.066975 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 989/1962] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:23:40.098724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15012a2a0e444aaa2238ab7e15d955f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:40.109832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15012a2a0e444aaa2238ab7e15d955f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:40.110606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15012a2a0e444aaa2238ab7e15d955f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:40.124930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15012a2a0e444aaa2238ab7e15d955f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:40.216944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15012a2a0e444aaa2238ab7e15d955f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:40.224584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 974/1963] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:39 2022] DELETE /identity/v3/users/e15012a2a0e444aaa2238ab7e15d955f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:40.228405 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83521e-58a0-4550-8559-f73ba3528d45 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:40.228620 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83521e-58a0-4550-8559-f73ba3528d45 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:40.228899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83521e-58a0-4550-8559-f73ba3528d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:40.248215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8a83521e-58a0-4550-8559-f73ba3528d45 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:40.249202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8a83521e-58a0-4550-8559-f73ba3528d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:40.315447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 990/1964] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:40.322905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:40.326162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:40.390916 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402d443-f486-48e5-ae8e-efd4347876bc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:40.394768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de821-aaac-4726-8b7e-a69a15b6114d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:40.395446 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de821-aaac-4726-8b7e-a69a15b6114d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:40.395746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de821-aaac-4726-8b7e-a69a15b6114d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:40.396010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de821-aaac-4726-8b7e-a69a15b6114d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:40.417652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de821-aaac-4726-8b7e-a69a15b6114d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:40.419181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de821-aaac-4726-8b7e-a69a15b6114d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:40.431515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 975/1965] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:41.115178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:41.199842 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:41.324030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83521e-58a0-4550-8559-f73ba3528d45 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:41.325494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8a83521e-58a0-4550-8559-f73ba3528d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:41.339327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83521e-58a0-4550-8559-f73ba3528d45 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:41.344777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:41.345817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:41.346163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:41.346523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] PATH_INFO: `/v3/projects/292538cf537246e692352583c880f51a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:41.347735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=292538cf537246e692352583c880f51a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:41.349653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:41.465151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292538cf537246e692352583c880f51a', 'request_id': 'req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:41.547594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292538cf537246e692352583c880f51a', 'request_id': 'req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:41.553513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292538cf537246e692352583c880f51a', 'request_id': 'req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:41.559477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:41.566572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] The token cache is being invalidate because project 292538cf537246e692352583c880f51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:41.566927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:41.567650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:41.569547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 991/1966] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:41 2022] DELETE /identity/v3/projects/292538cf537246e692352583c880f51a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:41.574532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de821-aaac-4726-8b7e-a69a15b6114d service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:41.584642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de821-aaac-4726-8b7e-a69a15b6114d service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:41.643382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:41.644616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:41.644820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:41.645274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] PATH_INFO: `/v3/users/62823bbb5a6c417eadba31f518b830cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:41.647085 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62823bbb5a6c417eadba31f518b830cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:41.650672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:41.863954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62823bbb5a6c417eadba31f518b830cb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:41.871424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62823bbb5a6c417eadba31f518b830cb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:41.872126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62823bbb5a6c417eadba31f518b830cb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:41.885593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62823bbb5a6c417eadba31f518b830cb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:41.994089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62823bbb5a6c417eadba31f518b830cb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.000679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 976/1967] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:41 2022] DELETE /identity/v3/users/62823bbb5a6c417eadba31f518b830cb => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:42.252895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:42.254422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:42.277677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:42.279352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:42.293623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:42.326385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8674-1ee6-4f17-b3fa-ba1116a77ba4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:42.368477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15d0ae-db31-4a37-a88d-6054c5c57768 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:42.374857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:42.375768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:42.376053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:42.376994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] PATH_INFO: `/v3/users/ff2aaf6cf5114ef8bccef7b57d65a501` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:42.379949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2aaf6cf5114ef8bccef7b57d65a501)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:42.382268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:42.399054 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:42.400723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:42.401289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:42.401719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:42.404354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:42.475050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:42.492860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:42.494313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:42.504802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 992/1968] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:42.629690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:42.631111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:42.644512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451e1de-897f-4afe-9261-00a889a252f7 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:42.650852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:42.650852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:42.656021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:42.656021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] PATH_INFO: `/v3/users/35876b46d2054a2e911a72253ea40f1c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:42.656021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35876b46d2054a2e911a72253ea40f1c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:42.656021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:42.667935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2aaf6cf5114ef8bccef7b57d65a501'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.681410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2aaf6cf5114ef8bccef7b57d65a501'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.682414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2aaf6cf5114ef8bccef7b57d65a501'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.703048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2aaf6cf5114ef8bccef7b57d65a501'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.850741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2aaf6cf5114ef8bccef7b57d65a501'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.862645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 977/1969] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:42 2022] DELETE /identity/v3/users/ff2aaf6cf5114ef8bccef7b57d65a501 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:42.868385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:42.874773 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:42.919317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35876b46d2054a2e911a72253ea40f1c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.924622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35876b46d2054a2e911a72253ea40f1c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.943083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35876b46d2054a2e911a72253ea40f1c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.944034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35876b46d2054a2e911a72253ea40f1c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:42.968813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8ab38c0c-7eaf-49f8-b043-dd0c28f14f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35876b46d2054a2e911a72253ea40f1c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.013191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416504-322e-4ae2-afa6-e92e849deeb0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:43.021044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:43.022167 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:43.022470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:43.024672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] PATH_INFO: `/v3/projects/6d4f8a8e13d8435a8ed2b814354acb03` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:43.025168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4f8a8e13d8435a8ed2b814354acb03)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:43.027114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:43.091363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 993/1970] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:42 2022] DELETE /identity/v3/users/35876b46d2054a2e911a72253ea40f1c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:43.093514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f781af-82fc-4cfd-a1f0-bce72c24087e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:43.093939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f781af-82fc-4cfd-a1f0-bce72c24087e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:43.094347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f781af-82fc-4cfd-a1f0-bce72c24087e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:43.123580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-07f781af-82fc-4cfd-a1f0-bce72c24087e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:43.124995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-07f781af-82fc-4cfd-a1f0-bce72c24087e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:43.160762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4f8a8e13d8435a8ed2b814354acb03', 'request_id': 'req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.202872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 994/1971] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:43.203848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f781af-82fc-4cfd-a1f0-bce72c24087e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:43.205250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-07f781af-82fc-4cfd-a1f0-bce72c24087e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:43.218906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f781af-82fc-4cfd-a1f0-bce72c24087e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:43.228766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4f8a8e13d8435a8ed2b814354acb03', 'request_id': 'req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.239998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4f8a8e13d8435a8ed2b814354acb03', 'request_id': 'req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.254872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] The token cache is being invalidate because project 6d4f8a8e13d8435a8ed2b814354acb03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:43.255206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.256394 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-931d52cb-85e1-4987-bbdf-21dd9b2f5f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.259842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 978/1972] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:42 2022] DELETE /identity/v3/projects/6d4f8a8e13d8435a8ed2b814354acb03 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:43.260435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:43.264453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f70a-f304-49d5-8b22-64ef234870ac None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:43.264453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f70a-f304-49d5-8b22-64ef234870ac None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:43.264453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f70a-f304-49d5-8b22-64ef234870ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:43.283001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-53c4f70a-f304-49d5-8b22-64ef234870ac None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:43.284219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-53c4f70a-f304-49d5-8b22-64ef234870ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:43.298040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:43.298957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:43.299247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:43.299527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] PATH_INFO: `/v3/users/f2f47d9b428540aaa68b3691a8af6006` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:43.300932 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f47d9b428540aaa68b3691a8af6006)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:43.302956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:43.325715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:43.352090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 979/1973] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:43.352946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f70a-f304-49d5-8b22-64ef234870ac None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:43.354344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-53c4f70a-f304-49d5-8b22-64ef234870ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:43.433258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f70a-f304-49d5-8b22-64ef234870ac None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:43.438486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:43.439226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:43.439579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:43.439954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:43.441959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:43.458736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:43.460195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:43.471647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 980/1974] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:43.479823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:43.481367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:43.494730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a2586-3eee-4158-a081-e7e12bc6d5cb service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:43.500147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:43.502881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:43.502881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:43.502881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] PATH_INFO: `/v3/users/6e4d0bde72c14328846557ef924b390e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:43.503113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4d0bde72c14328846557ef924b390e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:43.504923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:43.539948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f47d9b428540aaa68b3691a8af6006'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.540863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f47d9b428540aaa68b3691a8af6006'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.550682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f47d9b428540aaa68b3691a8af6006'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.551574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f47d9b428540aaa68b3691a8af6006'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.568105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f47d9b428540aaa68b3691a8af6006'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.660044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 995/1975] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:43 2022] DELETE /identity/v3/users/f2f47d9b428540aaa68b3691a8af6006 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:43.660044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:43.660044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:43.768666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34853f-b94d-4107-a830-a4815a9aab30 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:43.773193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916dcf4-1fe3-42b7-be24-93a547609115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:43.774342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916dcf4-1fe3-42b7-be24-93a547609115 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:43.774342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916dcf4-1fe3-42b7-be24-93a547609115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:43.774549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916dcf4-1fe3-42b7-be24-93a547609115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:43.777729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0916dcf4-1fe3-42b7-be24-93a547609115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:43.800023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4d0bde72c14328846557ef924b390e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.818378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4d0bde72c14328846557ef924b390e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.821960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4d0bde72c14328846557ef924b390e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.839908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4d0bde72c14328846557ef924b390e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.907547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916dcf4-1fe3-42b7-be24-93a547609115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:43.909185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916dcf4-1fe3-42b7-be24-93a547609115 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:43.922447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 996/1976] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:43.924156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061792bc-d2cf-4478-a4e8-241f99581d37 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:43.924588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061792bc-d2cf-4478-a4e8-241f99581d37 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:43.924969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061792bc-d2cf-4478-a4e8-241f99581d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:43.929341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4d0bde72c14328846557ef924b390e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:43.946559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 981/1977] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:43 2022] DELETE /identity/v3/users/6e4d0bde72c14328846557ef924b390e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:43.963693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-061792bc-d2cf-4478-a4e8-241f99581d37 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:43.970669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-061792bc-d2cf-4478-a4e8-241f99581d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:44.065087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 997/1978] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:44.105695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:44.107910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:44.198857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd7171-4a4f-4c00-b75a-8c683ba70d77 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:44.203195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e4275-6740-4a2e-9f1c-65bfaac932e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:44.203886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e4275-6740-4a2e-9f1c-65bfaac932e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:44.204342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e4275-6740-4a2e-9f1c-65bfaac932e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:44.204826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e4275-6740-4a2e-9f1c-65bfaac932e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:44.216157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e4275-6740-4a2e-9f1c-65bfaac932e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:44.219063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e4275-6740-4a2e-9f1c-65bfaac932e9 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:44.239648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:44.239648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 982/1979] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:44.374524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061792bc-d2cf-4478-a4e8-241f99581d37 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:44.375984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-061792bc-d2cf-4478-a4e8-241f99581d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:44.394933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061792bc-d2cf-4478-a4e8-241f99581d37 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:44.398484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:44.399940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:44.400392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:44.400737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] PATH_INFO: `/v3/projects/0ebf182ad3f74bf9974ed76ca189b67a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:44.402580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ebf182ad3f74bf9974ed76ca189b67a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:44.405051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:44.644621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebf182ad3f74bf9974ed76ca189b67a', 'request_id': 'req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:44.718930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e4275-6740-4a2e-9f1c-65bfaac932e9 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:44.720450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d36e4275-6740-4a2e-9f1c-65bfaac932e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:44.734791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e4275-6740-4a2e-9f1c-65bfaac932e9 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:44.749539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebf182ad3f74bf9974ed76ca189b67a', 'request_id': 'req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:44.767193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebf182ad3f74bf9974ed76ca189b67a', 'request_id': 'req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:44.791558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] The token cache is being invalidate because project 0ebf182ad3f74bf9974ed76ca189b67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:44.792805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:44.795158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:44.807675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 998/1980] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:44 2022] DELETE /identity/v3/projects/0ebf182ad3f74bf9974ed76ca189b67a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:44.809223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:44.812764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:44.887234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:44.888352 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:44.888647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:44.890021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] PATH_INFO: `/v3/projects/e0a2f98609d6439bb3865fe63a82c1bb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:44.892776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a2f98609d6439bb3865fe63a82c1bb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:44.895815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:44.903067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:44.949823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbbe75-8e40-4089-bb8a-e81bc08b7112 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:44.962484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:44.963716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:44.965100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:44.965561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] PATH_INFO: `/v3/users/ce537b7f004641cfb3e4c50a12a71ee6` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:44.967766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce537b7f004641cfb3e4c50a12a71ee6)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:44.970739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:45.071255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a2f98609d6439bb3865fe63a82c1bb', 'request_id': 'req-a391078e-aef2-4312-9fe1-db5928568722'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.171947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a2f98609d6439bb3865fe63a82c1bb', 'request_id': 'req-a391078e-aef2-4312-9fe1-db5928568722'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.180646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a2f98609d6439bb3865fe63a82c1bb', 'request_id': 'req-a391078e-aef2-4312-9fe1-db5928568722'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.197057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] The token cache is being invalidate because project e0a2f98609d6439bb3865fe63a82c1bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:45.197647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.198571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.202819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 983/1981] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:44 2022] DELETE /identity/v3/projects/e0a2f98609d6439bb3865fe63a82c1bb => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:45.207508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:45.207508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:45.231218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce537b7f004641cfb3e4c50a12a71ee6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.231968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce537b7f004641cfb3e4c50a12a71ee6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.239929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce537b7f004641cfb3e4c50a12a71ee6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.240711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce537b7f004641cfb3e4c50a12a71ee6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.263172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce537b7f004641cfb3e4c50a12a71ee6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.296436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391078e-aef2-4312-9fe1-db5928568722 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:45.301475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:45.302351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:45.302639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:45.302919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] PATH_INFO: `/v3/projects/7a7e0ac9b8b245b194bdc1c1a3051a65` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:45.304232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7e0ac9b8b245b194bdc1c1a3051a65)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:45.306908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:45.348578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 999/1982] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:44 2022] DELETE /identity/v3/users/ce537b7f004641cfb3e4c50a12a71ee6 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:45.352587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:45.354032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:45.425908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7e0ac9b8b245b194bdc1c1a3051a65', 'request_id': 'req-b173559d-0e2e-4907-b478-2db79d558f24'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.429502 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:45.446720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcd043-c4a2-48f3-9660-777fb2014352 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:45.485089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7e0ac9b8b245b194bdc1c1a3051a65', 'request_id': 'req-b173559d-0e2e-4907-b478-2db79d558f24'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.493041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7e0ac9b8b245b194bdc1c1a3051a65', 'request_id': 'req-b173559d-0e2e-4907-b478-2db79d558f24'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.506683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] The token cache is being invalidate because project 7a7e0ac9b8b245b194bdc1c1a3051a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:45.507353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.508253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b173559d-0e2e-4907-b478-2db79d558f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.511085 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 984/1983] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:45 2022] DELETE /identity/v3/projects/7a7e0ac9b8b245b194bdc1c1a3051a65 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:45.513132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8dd87-8431-48e1-b32c-149de4f27186 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:45.514690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8dd87-8431-48e1-b32c-149de4f27186 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:45.514690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8dd87-8431-48e1-b32c-149de4f27186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:45.517433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:45.518315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:45.518743 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:45.519030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] PATH_INFO: `/v3/projects/a27f5c79018b468c9746e06e330ac2ef` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:45.520890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27f5c79018b468c9746e06e330ac2ef)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:45.522892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:45.541060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d9c8dd87-8431-48e1-b32c-149de4f27186 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:45.542557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d9c8dd87-8431-48e1-b32c-149de4f27186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:45.567797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 985/1984] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:45.576923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8dd87-8431-48e1-b32c-149de4f27186 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:45.578302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d9c8dd87-8431-48e1-b32c-149de4f27186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:45.600080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8dd87-8431-48e1-b32c-149de4f27186 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:45.607659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:45.609875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:45.610170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:45.610458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] PATH_INFO: `/v3/users/605f2f16550d4d7eb94c026421c4fc3b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:45.612774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] RBAC: Authorizing `identity:delete_user(user_id=605f2f16550d4d7eb94c026421c4fc3b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:45.616045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:45.697912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27f5c79018b468c9746e06e330ac2ef', 'request_id': 'req-adc71b03-97a4-4297-a5d1-21264f63f317'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.818631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27f5c79018b468c9746e06e330ac2ef', 'request_id': 'req-adc71b03-97a4-4297-a5d1-21264f63f317'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.830191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27f5c79018b468c9746e06e330ac2ef', 'request_id': 'req-adc71b03-97a4-4297-a5d1-21264f63f317'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.857521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] The token cache is being invalidate because project a27f5c79018b468c9746e06e330ac2ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:45.858126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.859016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-adc71b03-97a4-4297-a5d1-21264f63f317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.860874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1000/1985] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:45 2022] DELETE /identity/v3/projects/a27f5c79018b468c9746e06e330ac2ef => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:45.862883 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e8bea-1a41-4814-9f3d-d0e46c6dbb47 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:45.863358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e8bea-1a41-4814-9f3d-d0e46c6dbb47 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:45.863649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e8bea-1a41-4814-9f3d-d0e46c6dbb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:45.911233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605f2f16550d4d7eb94c026421c4fc3b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.920411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-991e8bea-1a41-4814-9f3d-d0e46c6dbb47 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:45.921452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605f2f16550d4d7eb94c026421c4fc3b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.921888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605f2f16550d4d7eb94c026421c4fc3b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:45.922322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-991e8bea-1a41-4814-9f3d-d0e46c6dbb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:45.936042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605f2f16550d4d7eb94c026421c4fc3b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.029374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605f2f16550d4d7eb94c026421c4fc3b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.038021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 986/1986] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:45 2022] DELETE /identity/v3/users/605f2f16550d4d7eb94c026421c4fc3b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:46.043786 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:46.045491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:46.057209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1001/1987] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:46.057209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e8bea-1a41-4814-9f3d-d0e46c6dbb47 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:46.057209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-991e8bea-1a41-4814-9f3d-d0e46c6dbb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:46.092754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e8bea-1a41-4814-9f3d-d0e46c6dbb47 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:46.199168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754a1d4-da49-4269-8415-d5f73f1c002e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:46.205678 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:46.207690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:46.209490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:46.209931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] PATH_INFO: `/v3/projects/11e19de3f7b641bb9f40139f0fd1f129` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:46.211786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e19de3f7b641bb9f40139f0fd1f129)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:46.212481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:46.213499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:46.214809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:46.216053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] PATH_INFO: `/v3/users/1c6c226d4ee44ea587725e27fd642ccd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:46.216605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:46.217667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6c226d4ee44ea587725e27fd642ccd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:46.219812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:46.475241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6c226d4ee44ea587725e27fd642ccd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.478218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e19de3f7b641bb9f40139f0fd1f129', 'request_id': 'req-0ebc0d54-f015-4bfb-8796-150e7eec207c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.485061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6c226d4ee44ea587725e27fd642ccd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.486133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6c226d4ee44ea587725e27fd642ccd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.502743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6c226d4ee44ea587725e27fd642ccd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.560991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e19de3f7b641bb9f40139f0fd1f129', 'request_id': 'req-0ebc0d54-f015-4bfb-8796-150e7eec207c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.567902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e19de3f7b641bb9f40139f0fd1f129', 'request_id': 'req-0ebc0d54-f015-4bfb-8796-150e7eec207c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.580358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] The token cache is being invalidate because project 11e19de3f7b641bb9f40139f0fd1f129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:46.580725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.581490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.583113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1002/1988] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:46 2022] DELETE /identity/v3/projects/11e19de3f7b641bb9f40139f0fd1f129 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:46.584024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:46.586599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:46.627726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d5471cd0-08e4-4970-afcc-bd8a72083c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6c226d4ee44ea587725e27fd642ccd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.634508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 987/1989] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:46 2022] DELETE /identity/v3/users/1c6c226d4ee44ea587725e27fd642ccd => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:46.635917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd577b-a216-4c50-80a1-a42aabb6e7a1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:46.636260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd577b-a216-4c50-80a1-a42aabb6e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:46.636620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd577b-a216-4c50-80a1-a42aabb6e7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:46.649403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc0d54-f015-4bfb-8796-150e7eec207c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:46.655977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c2fd577b-a216-4c50-80a1-a42aabb6e7a1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:46.657850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c2fd577b-a216-4c50-80a1-a42aabb6e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:46.659353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:46.745514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 988/1990] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:46.746454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd577b-a216-4c50-80a1-a42aabb6e7a1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:46.752540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d8d6b-9c06-4d18-8c9a-dde3b9732e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:46.753041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c2fd577b-a216-4c50-80a1-a42aabb6e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:46.753860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d8d6b-9c06-4d18-8c9a-dde3b9732e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:46.757902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d8d6b-9c06-4d18-8c9a-dde3b9732e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:46.757902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d8d6b-9c06-4d18-8c9a-dde3b9732e63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:46.757902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d8d6b-9c06-4d18-8c9a-dde3b9732e63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:46.757902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d8d6b-9c06-4d18-8c9a-dde3b9732e63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:46.757902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d8d6b-9c06-4d18-8c9a-dde3b9732e63 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:46.765590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd577b-a216-4c50-80a1-a42aabb6e7a1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:46.770407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:46.770916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1003/1991] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:46.772427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac010-043b-47d2-9b6b-81f2b743099f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:46.772724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac010-043b-47d2-9b6b-81f2b743099f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:46.773018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac010-043b-47d2-9b6b-81f2b743099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:46.773680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:46.774125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:46.774715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] PATH_INFO: `/v3/projects/644535e7be234242b9456545372394ad` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:46.776918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=644535e7be234242b9456545372394ad)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:46.785895 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:46.794577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-71dac010-043b-47d2-9b6b-81f2b743099f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:46.795933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-71dac010-043b-47d2-9b6b-81f2b743099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:46.804627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1004/1992] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:46.805500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac010-043b-47d2-9b6b-81f2b743099f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:46.807218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-71dac010-043b-47d2-9b6b-81f2b743099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:46.818991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac010-043b-47d2-9b6b-81f2b743099f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:46.823723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09fa48-d7c6-4856-a36d-aafb93df6ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:46.824329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09fa48-d7c6-4856-a36d-aafb93df6ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:46.824622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09fa48-d7c6-4856-a36d-aafb93df6ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:46.824902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09fa48-d7c6-4856-a36d-aafb93df6ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:46.825585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09fa48-d7c6-4856-a36d-aafb93df6ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:46.827732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09fa48-d7c6-4856-a36d-aafb93df6ebe admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:46.837650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:46.909013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644535e7be234242b9456545372394ad', 'request_id': 'req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.955878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1005/1993] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:46 2022] POST /identity/v3/projects => generated 389 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:46.957003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09fa48-d7c6-4856-a36d-aafb93df6ebe admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:46.982586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644535e7be234242b9456545372394ad', 'request_id': 'req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:46.990836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644535e7be234242b9456545372394ad', 'request_id': 'req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.003799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] The token cache is being invalidate because project 644535e7be234242b9456545372394ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:47.004327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.005030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.006715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 989/1994] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:46 2022] DELETE /identity/v3/projects/644535e7be234242b9456545372394ad => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:47.007640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.008966 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.035200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09fa48-d7c6-4856-a36d-aafb93df6ebe admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.040730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.042176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.042176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.042176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.042686 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:47.043018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.044631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.059904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1006/1995] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:47.059904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.059904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.071915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faafb2f-217c-4297-a60e-18d6fc4e929f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.075456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b51d6c-ae0f-48d1-aa9d-d92ddff5dcf6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.076598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.077459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.077762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.078019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] PATH_INFO: `/v3/users/c0f199cd9ed044a09aa64ddf6949ba9a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.079177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f199cd9ed044a09aa64ddf6949ba9a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.080130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01c671-3343-459d-a984-d946cb06abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.080823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c671-3343-459d-a984-d946cb06abc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.081113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c671-3343-459d-a984-d946cb06abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.081203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.081391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c671-3343-459d-a984-d946cb06abc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.082074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01c671-3343-459d-a984-d946cb06abc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.084180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01c671-3343-459d-a984-d946cb06abc0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.176231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 990/1996] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:47 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:47.176942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01c671-3343-459d-a984-d946cb06abc0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.178621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-df01c671-3343-459d-a984-d946cb06abc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.191557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01c671-3343-459d-a984-d946cb06abc0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.196883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b601eb-84f6-42a1-944a-e89789179f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.197828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b601eb-84f6-42a1-944a-e89789179f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.198120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b601eb-84f6-42a1-944a-e89789179f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.198401 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b601eb-84f6-42a1-944a-e89789179f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.199144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b601eb-84f6-42a1-944a-e89789179f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.201092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b601eb-84f6-42a1-944a-e89789179f3f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.311402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 991/1997] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:47 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:47.312915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b601eb-84f6-42a1-944a-e89789179f3f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.321814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-21b601eb-84f6-42a1-944a-e89789179f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.324629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f199cd9ed044a09aa64ddf6949ba9a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.325285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f199cd9ed044a09aa64ddf6949ba9a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.334473 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f199cd9ed044a09aa64ddf6949ba9a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.334627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f199cd9ed044a09aa64ddf6949ba9a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.347576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f199cd9ed044a09aa64ddf6949ba9a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.357389 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:47.394626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b601eb-84f6-42a1-944a-e89789179f3f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.400958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.400958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.400958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.400958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] PATH_INFO: `/v3/projects/4c48f92d3085464a955a83dbfe08b0e9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.402119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c48f92d3085464a955a83dbfe08b0e9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.404041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.461009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1007/1998] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:47 2022] DELETE /identity/v3/users/c0f199cd9ed044a09aa64ddf6949ba9a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:47.461009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.461009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.534967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6997d-7d23-4d45-b87d-63eb962e547c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.541869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0aa4b-7f8d-4139-930b-d4c48ac4493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.542934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0aa4b-7f8d-4139-930b-d4c48ac4493a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.543483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0aa4b-7f8d-4139-930b-d4c48ac4493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.543902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0aa4b-7f8d-4139-930b-d4c48ac4493a admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.545067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0aa4b-7f8d-4139-930b-d4c48ac4493a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.546839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0aa4b-7f8d-4139-930b-d4c48ac4493a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.558944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1008/1999] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:47.560065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0aa4b-7f8d-4139-930b-d4c48ac4493a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.562681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-77d0aa4b-7f8d-4139-930b-d4c48ac4493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.566020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c48f92d3085464a955a83dbfe08b0e9', 'request_id': 'req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.577182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0aa4b-7f8d-4139-930b-d4c48ac4493a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.633850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734937de-32a4-403a-bf94-18c580e66f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.634531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734937de-32a4-403a-bf94-18c580e66f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.634813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734937de-32a4-403a-bf94-18c580e66f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.635086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734937de-32a4-403a-bf94-18c580e66f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.635772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734937de-32a4-403a-bf94-18c580e66f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.637784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734937de-32a4-403a-bf94-18c580e66f1a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.661500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c48f92d3085464a955a83dbfe08b0e9', 'request_id': 'req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.669349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c48f92d3085464a955a83dbfe08b0e9', 'request_id': 'req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.680681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] The token cache is being invalidate because project 4c48f92d3085464a955a83dbfe08b0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:47.681129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.681800 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.683643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 992/2000] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:47 2022] DELETE /identity/v3/projects/4c48f92d3085464a955a83dbfe08b0e9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:47.684420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.687824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.698948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cef19d-c20b-4ca6-a408-a1d9d1a7b086 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.703680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.704608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.704898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.705260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] PATH_INFO: `/v3/users/ae41c7a1eb7c40349058e08091a663a5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.706885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae41c7a1eb7c40349058e08091a663a5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.709039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.786044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1009/2001] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:47 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:47.786044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734937de-32a4-403a-bf94-18c580e66f1a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.787752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-734937de-32a4-403a-bf94-18c580e66f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.809408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734937de-32a4-403a-bf94-18c580e66f1a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.816607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39429e44-6c15-4003-8943-7b1e176d9a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.817433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39429e44-6c15-4003-8943-7b1e176d9a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.817910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39429e44-6c15-4003-8943-7b1e176d9a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.818283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39429e44-6c15-4003-8943-7b1e176d9a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.819486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39429e44-6c15-4003-8943-7b1e176d9a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.821610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39429e44-6c15-4003-8943-7b1e176d9a07 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.832802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1010/2002] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:47.834218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead3625-2c75-483d-8341-57005db645ad None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.837578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead3625-2c75-483d-8341-57005db645ad None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.837578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead3625-2c75-483d-8341-57005db645ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.855635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bead3625-2c75-483d-8341-57005db645ad None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:47.857118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bead3625-2c75-483d-8341-57005db645ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.865446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1011/2003] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:47.866611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead3625-2c75-483d-8341-57005db645ad None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.867541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bead3625-2c75-483d-8341-57005db645ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:47.879332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead3625-2c75-483d-8341-57005db645ad None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.884499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dade622-8226-4ad4-a15b-92785383afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.885185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dade622-8226-4ad4-a15b-92785383afa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.885472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dade622-8226-4ad4-a15b-92785383afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.885738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dade622-8226-4ad4-a15b-92785383afa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.886461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dade622-8226-4ad4-a15b-92785383afa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.888052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dade622-8226-4ad4-a15b-92785383afa9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.899082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1012/2004] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:47.899945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dade622-8226-4ad4-a15b-92785383afa9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:47.909681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dade622-8226-4ad4-a15b-92785383afa9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:47.915141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07745b-9055-4925-bc2c-0f40909ad2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:47.916014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07745b-9055-4925-bc2c-0f40909ad2ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:47.916301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07745b-9055-4925-bc2c-0f40909ad2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:47.916610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07745b-9055-4925-bc2c-0f40909ad2ad admin admin] PATH_INFO: `/v3/projects/8e17dd84314d4ae0a76614262becbda3/users/5397960e9f6a4770add9f384f9424c4d/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:47.933546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07745b-9055-4925-bc2c-0f40909ad2ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e17dd84314d4ae0a76614262becbda3, user_id=5397960e9f6a4770add9f384f9424c4d, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:47.933720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae41c7a1eb7c40349058e08091a663a5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.936434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07745b-9055-4925-bc2c-0f40909ad2ad admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:47.940793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae41c7a1eb7c40349058e08091a663a5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.941459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae41c7a1eb7c40349058e08091a663a5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:47.958398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae41c7a1eb7c40349058e08091a663a5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.012487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1013/2005] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:47 2022] PUT /identity/v3/projects/8e17dd84314d4ae0a76614262becbda3/users/5397960e9f6a4770add9f384f9424c4d/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:48.014136 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c4ef0-ba8e-4400-a4ff-5674e3fa1218 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.014523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c4ef0-ba8e-4400-a4ff-5674e3fa1218 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.014896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c4ef0-ba8e-4400-a4ff-5674e3fa1218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.034666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae41c7a1eb7c40349058e08091a663a5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.041823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-126c4ef0-ba8e-4400-a4ff-5674e3fa1218 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:48.043057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-126c4ef0-ba8e-4400-a4ff-5674e3fa1218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.045844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 993/2006] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:47 2022] DELETE /identity/v3/users/ae41c7a1eb7c40349058e08091a663a5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:48.047073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:48.049420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.117002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1014/2007] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:48.117002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c4ef0-ba8e-4400-a4ff-5674e3fa1218 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:48.117002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-126c4ef0-ba8e-4400-a4ff-5674e3fa1218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.122705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61209bca-9bcb-4c90-8b99-32db9db66f88 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:48.127646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97f606-1850-4e12-8a81-e33dde8df68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:48.128342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97f606-1850-4e12-8a81-e33dde8df68b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.128633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97f606-1850-4e12-8a81-e33dde8df68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.128906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97f606-1850-4e12-8a81-e33dde8df68b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.129216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c4ef0-ba8e-4400-a4ff-5674e3fa1218 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:48.129663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97f606-1850-4e12-8a81-e33dde8df68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:48.131370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97f606-1850-4e12-8a81-e33dde8df68b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:48.134762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:48.135656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.135938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.136210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] PATH_INFO: `/v3/projects/af2b0a00bf0945f7aa695e47cf15360b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.137459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2b0a00bf0945f7aa695e47cf15360b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:48.139386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:48.145173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 994/2008] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:48.147086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526383b-8e0b-4087-a774-6c8ba03b8a01 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.147381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526383b-8e0b-4087-a774-6c8ba03b8a01 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.147665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526383b-8e0b-4087-a774-6c8ba03b8a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.169993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:48.176340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3526383b-8e0b-4087-a774-6c8ba03b8a01 None None] MFA Rules not processed for user `5397960e9f6a4770add9f384f9424c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:48.177929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3526383b-8e0b-4087-a774-6c8ba03b8a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.242065 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 995/2009] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:48.243532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35bac2-7662-4580-8514-8f17f66c4b80 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.243829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35bac2-7662-4580-8514-8f17f66c4b80 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.244112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35bac2-7662-4580-8514-8f17f66c4b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.261654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ec35bac2-7662-4580-8514-8f17f66c4b80 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:48.262846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ec35bac2-7662-4580-8514-8f17f66c4b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.270718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 996/2010] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:48.271724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35bac2-7662-4580-8514-8f17f66c4b80 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:48.281581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35bac2-7662-4580-8514-8f17f66c4b80 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:48.285574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2b0a00bf0945f7aa695e47cf15360b', 'request_id': 'req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.335655 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940bc1c-f46b-4383-9124-217a70a747fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:48.337200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940bc1c-f46b-4383-9124-217a70a747fe admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.337570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940bc1c-f46b-4383-9124-217a70a747fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.337844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940bc1c-f46b-4383-9124-217a70a747fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.338573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940bc1c-f46b-4383-9124-217a70a747fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:48.338879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940bc1c-f46b-4383-9124-217a70a747fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:48.340521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940bc1c-f46b-4383-9124-217a70a747fe admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:48.352163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 997/2011] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:48.353002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940bc1c-f46b-4383-9124-217a70a747fe admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:48.362661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940bc1c-f46b-4383-9124-217a70a747fe admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:48.367803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923e639-93a3-43b8-81ad-5eaeb1bcd9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:48.368647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923e639-93a3-43b8-81ad-5eaeb1bcd9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.368931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923e639-93a3-43b8-81ad-5eaeb1bcd9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.369247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923e639-93a3-43b8-81ad-5eaeb1bcd9c8 admin admin] PATH_INFO: `/v3/projects/fe64f4356ddc49c5ad6bdad68feddf02/users/0be8c324676b471584a7a26f31e6a37b/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.385516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923e639-93a3-43b8-81ad-5eaeb1bcd9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe64f4356ddc49c5ad6bdad68feddf02, user_id=0be8c324676b471584a7a26f31e6a37b, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:48.388205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923e639-93a3-43b8-81ad-5eaeb1bcd9c8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:48.410920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2b0a00bf0945f7aa695e47cf15360b', 'request_id': 'req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.417106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2b0a00bf0945f7aa695e47cf15360b', 'request_id': 'req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.430456 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] The token cache is being invalidate because project af2b0a00bf0945f7aa695e47cf15360b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:48.430750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.431531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8a939b7f-bdaa-4cff-8f85-f3a913bd0d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.433373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1015/2012] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:48 2022] DELETE /identity/v3/projects/af2b0a00bf0945f7aa695e47cf15360b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:48.434647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4559ad-cdb4-42aa-9d8a-d2517ab6ebce None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.434934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4559ad-cdb4-42aa-9d8a-d2517ab6ebce None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.435211 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4559ad-cdb4-42aa-9d8a-d2517ab6ebce None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.436826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1016/2013] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:23:48.437825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4559ad-cdb4-42aa-9d8a-d2517ab6ebce None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:48.439452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fb4559ad-cdb4-42aa-9d8a-d2517ab6ebce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.455750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4559ad-cdb4-42aa-9d8a-d2517ab6ebce None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:48.463102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 998/2014] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:48 2022] PUT /identity/v3/projects/fe64f4356ddc49c5ad6bdad68feddf02/users/0be8c324676b471584a7a26f31e6a37b/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:48.464143 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923e639-93a3-43b8-81ad-5eaeb1bcd9c8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:48.466168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8923e639-93a3-43b8-81ad-5eaeb1bcd9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.526412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6a09-5dc5-4dcf-afba-b1afb8fc0ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:48.527245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6a09-5dc5-4dcf-afba-b1afb8fc0ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.527530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6a09-5dc5-4dcf-afba-b1afb8fc0ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.527809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6a09-5dc5-4dcf-afba-b1afb8fc0ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.528537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc6a09-5dc5-4dcf-afba-b1afb8fc0ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:48.530593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc6a09-5dc5-4dcf-afba-b1afb8fc0ed1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:48.531952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923e639-93a3-43b8-81ad-5eaeb1bcd9c8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:48.536022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:48.536674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:48.537120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.537120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.537299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.539102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.552189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:48.553820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:48.564619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 999/2015] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:48.565554 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:48.566960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.579111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bf391-4fe2-4be9-8340-f9020084a706 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:48.583908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:48.584812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.585101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.585379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] PATH_INFO: `/v3/users/f1306e17dbfe4868a35b8570055d6b4c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.586598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1306e17dbfe4868a35b8570055d6b4c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:48.588558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:48.618270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1017/2016] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:48 2022] POST /identity/v3/projects => generated 389 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:48.619013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6a09-5dc5-4dcf-afba-b1afb8fc0ed1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:48.620669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c7dc6a09-5dc5-4dcf-afba-b1afb8fc0ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.683860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6a09-5dc5-4dcf-afba-b1afb8fc0ed1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:48.689158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ba483-2ab9-461c-8429-56c5326721f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:48.689831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba483-2ab9-461c-8429-56c5326721f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.690120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba483-2ab9-461c-8429-56c5326721f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.690400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba483-2ab9-461c-8429-56c5326721f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.691154 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ba483-2ab9-461c-8429-56c5326721f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:48.693098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ba483-2ab9-461c-8429-56c5326721f0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:48.790367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1018/2017] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:48 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:48.807646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75e37-d78f-46de-b954-87b6989a5e6f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.807646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75e37-d78f-46de-b954-87b6989a5e6f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.807646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75e37-d78f-46de-b954-87b6989a5e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.817180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f4a75e37-d78f-46de-b954-87b6989a5e6f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:48.817942 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1306e17dbfe4868a35b8570055d6b4c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.818554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f4a75e37-d78f-46de-b954-87b6989a5e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.827972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1306e17dbfe4868a35b8570055d6b4c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.829835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1306e17dbfe4868a35b8570055d6b4c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.847171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1306e17dbfe4868a35b8570055d6b4c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.884041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1019/2018] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:48.884041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367d20-ce90-4fd8-9430-846fa18df3b9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.884262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367d20-ce90-4fd8-9430-846fa18df3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.884599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367d20-ce90-4fd8-9430-846fa18df3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.902625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-27367d20-ce90-4fd8-9430-846fa18df3b9 None None] MFA Rules not processed for user `257d9a088fa04cd5af48d6e4fb8b2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:48.903959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-27367d20-ce90-4fd8-9430-846fa18df3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:48.966685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1020/2019] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:23:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:48.968141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85640b-b756-430a-bccc-61781174ac1a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:48.968472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85640b-b756-430a-bccc-61781174ac1a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:48.968753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85640b-b756-430a-bccc-61781174ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:48.987068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1306e17dbfe4868a35b8570055d6b4c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:48.994265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1000/2020] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:48 2022] DELETE /identity/v3/users/f1306e17dbfe4868a35b8570055d6b4c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:49.162447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.162447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.163896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8d85640b-b756-430a-bccc-61781174ac1a None None] MFA Rules not processed for user `0be8c324676b471584a7a26f31e6a37b`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:49.163896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8d85640b-b756-430a-bccc-61781174ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.163896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1021/2021] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:49.164654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043079de-8a2e-4b1e-864d-164e78dca922 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.164732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85640b-b756-430a-bccc-61781174ac1a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.164732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8d85640b-b756-430a-bccc-61781174ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.164896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ab22e-ad88-4086-96a2-89027642de24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.164896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ab22e-ad88-4086-96a2-89027642de24 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.164896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ab22e-ad88-4086-96a2-89027642de24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.164896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ab22e-ad88-4086-96a2-89027642de24 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.165220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ab22e-ad88-4086-96a2-89027642de24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.165220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ab22e-ad88-4086-96a2-89027642de24 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.165377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85640b-b756-430a-bccc-61781174ac1a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.165377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0589d-acbe-4c8a-8ea7-ab68bc71ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.165377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0589d-acbe-4c8a-8ea7-ab68bc71ef58 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.165377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0589d-acbe-4c8a-8ea7-ab68bc71ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.165694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0589d-acbe-4c8a-8ea7-ab68bc71ef58 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.165694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0589d-acbe-4c8a-8ea7-ab68bc71ef58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.165694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0589d-acbe-4c8a-8ea7-ab68bc71ef58 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.231506 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:49.310331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1001/2022] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:48 2022] POST /identity/v3/users => generated 301 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:49.310331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9985819-da82-46d2-b8d2-51cb20dd259c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.310331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9985819-da82-46d2-b8d2-51cb20dd259c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.310331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9985819-da82-46d2-b8d2-51cb20dd259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.327118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b9985819-da82-46d2-b8d2-51cb20dd259c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:49.328333 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b9985819-da82-46d2-b8d2-51cb20dd259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.336514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1002/2023] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:49.337227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9985819-da82-46d2-b8d2-51cb20dd259c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.338395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b9985819-da82-46d2-b8d2-51cb20dd259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.403808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9985819-da82-46d2-b8d2-51cb20dd259c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.408765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.409412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.409689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.409961 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.411696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.423113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.424658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.433972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1003/2024] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:49.434718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.435951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.448798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1907a9-8852-4503-9140-b3603c7f59aa service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.453897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ff913-27c9-42d4-863b-269500b8a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.454587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ff913-27c9-42d4-863b-269500b8a0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.454872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ff913-27c9-42d4-863b-269500b8a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.455147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ff913-27c9-42d4-863b-269500b8a0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.455835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ff913-27c9-42d4-863b-269500b8a0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.457756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ff913-27c9-42d4-863b-269500b8a0e7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.537008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1022/2025] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:49 2022] POST /identity/v3/users => generated 292 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:49.538727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0589d-acbe-4c8a-8ea7-ab68bc71ef58 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.540350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e2c0589d-acbe-4c8a-8ea7-ab68bc71ef58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.552190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0589d-acbe-4c8a-8ea7-ab68bc71ef58 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.556722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.557625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.557912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.558190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] PATH_INFO: `/v3/projects/20efd385fdab48afbe83bd9c46d43a05` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.559351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20efd385fdab48afbe83bd9c46d43a05)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.561287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.653542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1004/2026] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:49 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:49.654921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ff913-27c9-42d4-863b-269500b8a0e7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.721553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20efd385fdab48afbe83bd9c46d43a05', 'request_id': 'req-488d7744-45ff-4dc0-a3d6-8068c22969d3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:49.729805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ff913-27c9-42d4-863b-269500b8a0e7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.776385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20efd385fdab48afbe83bd9c46d43a05', 'request_id': 'req-488d7744-45ff-4dc0-a3d6-8068c22969d3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:49.782365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20efd385fdab48afbe83bd9c46d43a05', 'request_id': 'req-488d7744-45ff-4dc0-a3d6-8068c22969d3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:49.786486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba394-3203-459a-a068-96cb902fc181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.787176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba394-3203-459a-a068-96cb902fc181 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.787476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba394-3203-459a-a068-96cb902fc181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.787737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba394-3203-459a-a068-96cb902fc181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.788497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ba394-3203-459a-a068-96cb902fc181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.790147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ba394-3203-459a-a068-96cb902fc181 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.803852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1005/2027] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:49.803852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba394-3203-459a-a068-96cb902fc181 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.809619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] The token cache is being invalidate because project 20efd385fdab48afbe83bd9c46d43a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:49.809619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:49.809619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:49.809619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1023/2028] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:49 2022] DELETE /identity/v3/projects/20efd385fdab48afbe83bd9c46d43a05 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:49.809619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.811416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.813641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba394-3203-459a-a068-96cb902fc181 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.818247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.818905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.819193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.819469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.820185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:49.821057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.822657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.824649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d7744-45ff-4dc0-a3d6-8068c22969d3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.829186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cc259-c23d-48a7-9d2d-260bfbea1a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.829843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cc259-c23d-48a7-9d2d-260bfbea1a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.830126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cc259-c23d-48a7-9d2d-260bfbea1a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.830394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cc259-c23d-48a7-9d2d-260bfbea1a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.831105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cc259-c23d-48a7-9d2d-260bfbea1a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.832696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cc259-c23d-48a7-9d2d-260bfbea1a19 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.834588 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1006/2029] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:49.835384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.839722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.843628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1024/2030] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:49.844442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cc259-c23d-48a7-9d2d-260bfbea1a19 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.846712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d13cc259-c23d-48a7-9d2d-260bfbea1a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.853440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe410d8-6b37-4d18-a346-7c8f69ca36a4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.857996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.861915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cc259-c23d-48a7-9d2d-260bfbea1a19 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.862113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.862113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.862113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] PATH_INFO: `/v3/projects/4e782993fa5b431b8a74c8c9bd400d64` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.862113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e782993fa5b431b8a74c8c9bd400d64)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.862470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.863850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836255d-17e8-4020-9aa5-ba56f3cf61d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:49.864528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836255d-17e8-4020-9aa5-ba56f3cf61d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:49.864819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836255d-17e8-4020-9aa5-ba56f3cf61d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:49.865081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836255d-17e8-4020-9aa5-ba56f3cf61d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:49.865756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836255d-17e8-4020-9aa5-ba56f3cf61d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:49.867668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836255d-17e8-4020-9aa5-ba56f3cf61d8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:49.970688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1025/2031] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:49 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:49.971427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836255d-17e8-4020-9aa5-ba56f3cf61d8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:49.972985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9836255d-17e8-4020-9aa5-ba56f3cf61d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:49.984690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836255d-17e8-4020-9aa5-ba56f3cf61d8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:49.993778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e782993fa5b431b8a74c8c9bd400d64', 'request_id': 'req-18b5ff96-c89b-4151-8018-4ffa2418af16'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.040367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc54f8-395b-451f-bc44-b4fc459560c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.041241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc54f8-395b-451f-bc44-b4fc459560c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.041529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc54f8-395b-451f-bc44-b4fc459560c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.041809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc54f8-395b-451f-bc44-b4fc459560c7 admin admin] PATH_INFO: `/v3/projects/9a22c6ef85ae4c9ebdeb05119a559e6a/users/80b2613e7bb74804b49a86d5fcbab513/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.056151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc54f8-395b-451f-bc44-b4fc459560c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a22c6ef85ae4c9ebdeb05119a559e6a, user_id=80b2613e7bb74804b49a86d5fcbab513, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.058935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc54f8-395b-451f-bc44-b4fc459560c7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.090833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e782993fa5b431b8a74c8c9bd400d64', 'request_id': 'req-18b5ff96-c89b-4151-8018-4ffa2418af16'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.097450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e782993fa5b431b8a74c8c9bd400d64', 'request_id': 'req-18b5ff96-c89b-4151-8018-4ffa2418af16'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.107573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] The token cache is being invalidate because project 4e782993fa5b431b8a74c8c9bd400d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:50.107860 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.108530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.110076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1007/2032] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:49 2022] DELETE /identity/v3/projects/4e782993fa5b431b8a74c8c9bd400d64 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:50.111000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.112243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.125497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5ff96-c89b-4151-8018-4ffa2418af16 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.130089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.130953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.131218 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.131493 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] PATH_INFO: `/v3/users/59e50b0a8f874c58aaaad225a0397682` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.132695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e50b0a8f874c58aaaad225a0397682)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.135165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.142839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1026/2033] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:49 2022] PUT /identity/v3/projects/9a22c6ef85ae4c9ebdeb05119a559e6a/users/80b2613e7bb74804b49a86d5fcbab513/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:50.148756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc54f8-395b-451f-bc44-b4fc459560c7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.148756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cbbc54f8-395b-451f-bc44-b4fc459560c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.207278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc54f8-395b-451f-bc44-b4fc459560c7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.212404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfbb7d-688b-4a9d-8e7b-f93aa703ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.213093 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfbb7d-688b-4a9d-8e7b-f93aa703ae3e admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.213379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfbb7d-688b-4a9d-8e7b-f93aa703ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.213655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfbb7d-688b-4a9d-8e7b-f93aa703ae3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.214377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfbb7d-688b-4a9d-8e7b-f93aa703ae3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.216444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfbb7d-688b-4a9d-8e7b-f93aa703ae3e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.303114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1027/2034] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:50 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:50.303927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfbb7d-688b-4a9d-8e7b-f93aa703ae3e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.306074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-78bfbb7d-688b-4a9d-8e7b-f93aa703ae3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.338911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e50b0a8f874c58aaaad225a0397682'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.345560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e50b0a8f874c58aaaad225a0397682'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.346322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e50b0a8f874c58aaaad225a0397682'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.358239 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e50b0a8f874c58aaaad225a0397682'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.369226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfbb7d-688b-4a9d-8e7b-f93aa703ae3e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.373924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e890963-98ca-4ee5-8f57-51625ae20760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.374648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e890963-98ca-4ee5-8f57-51625ae20760 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.374937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e890963-98ca-4ee5-8f57-51625ae20760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.375218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e890963-98ca-4ee5-8f57-51625ae20760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.375942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e890963-98ca-4ee5-8f57-51625ae20760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.377575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e890963-98ca-4ee5-8f57-51625ae20760 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.387353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1028/2035] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:50.388279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e890963-98ca-4ee5-8f57-51625ae20760 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.389938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9e890963-98ca-4ee5-8f57-51625ae20760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.402594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e890963-98ca-4ee5-8f57-51625ae20760 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.407381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53000988-828b-4147-9506-1615e29a7834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.408044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000988-828b-4147-9506-1615e29a7834 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.408365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000988-828b-4147-9506-1615e29a7834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.408648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000988-828b-4147-9506-1615e29a7834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.409420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53000988-828b-4147-9506-1615e29a7834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.411006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53000988-828b-4147-9506-1615e29a7834 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.422699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1029/2036] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:50.424085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311681b-c61a-4bd0-97b8-5cd8360ae601 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.424249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311681b-c61a-4bd0-97b8-5cd8360ae601 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.424554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311681b-c61a-4bd0-97b8-5cd8360ae601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.442946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8311681b-c61a-4bd0-97b8-5cd8360ae601 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:50.444206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8311681b-c61a-4bd0-97b8-5cd8360ae601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.450728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e50b0a8f874c58aaaad225a0397682'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:50.452356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1030/2037] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:50.453101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311681b-c61a-4bd0-97b8-5cd8360ae601 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.454330 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8311681b-c61a-4bd0-97b8-5cd8360ae601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.459182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1008/2038] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:50 2022] DELETE /identity/v3/users/59e50b0a8f874c58aaaad225a0397682 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:50.459182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.462197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.466923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311681b-c61a-4bd0-97b8-5cd8360ae601 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.527395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abb21b-0576-494b-a3d7-657c1b2cb6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.528445 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abb21b-0576-494b-a3d7-657c1b2cb6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.528948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abb21b-0576-494b-a3d7-657c1b2cb6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.529230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abb21b-0576-494b-a3d7-657c1b2cb6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.530001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abb21b-0576-494b-a3d7-657c1b2cb6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.531872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abb21b-0576-494b-a3d7-657c1b2cb6d9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.535142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7d53b-a453-4057-9b47-76d8f9da6e36 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.541071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb49b57-1c86-47e6-8309-07b8622011e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.545060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49b57-1c86-47e6-8309-07b8622011e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.545060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49b57-1c86-47e6-8309-07b8622011e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.545060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49b57-1c86-47e6-8309-07b8622011e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.545060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb49b57-1c86-47e6-8309-07b8622011e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.545917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1031/2039] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:50.546498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb49b57-1c86-47e6-8309-07b8622011e8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.546834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abb21b-0576-494b-a3d7-657c1b2cb6d9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.548521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-46abb21b-0576-494b-a3d7-657c1b2cb6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.562695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abb21b-0576-494b-a3d7-657c1b2cb6d9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.567400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ff6e-5ee1-4809-b0be-b191aa201818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.568290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ff6e-5ee1-4809-b0be-b191aa201818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.568610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ff6e-5ee1-4809-b0be-b191aa201818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.568890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ff6e-5ee1-4809-b0be-b191aa201818 admin admin] PATH_INFO: `/v3/projects/8fd5523a876549e1919db594410191f5/users/a38b03fab5724b9da34145957c95e718/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.583448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25ff6e-5ee1-4809-b0be-b191aa201818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd5523a876549e1919db594410191f5, user_id=a38b03fab5724b9da34145957c95e718, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.586262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25ff6e-5ee1-4809-b0be-b191aa201818 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.616054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:50.657215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1009/2040] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:50 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:50.662051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1032/2041] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:50 2022] PUT /identity/v3/projects/8fd5523a876549e1919db594410191f5/users/a38b03fab5724b9da34145957c95e718/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:50.662184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb49b57-1c86-47e6-8309-07b8622011e8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.662276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134de3-c9c0-4e97-ab46-875eafdf62a9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.662276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134de3-c9c0-4e97-ab46-875eafdf62a9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.662453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7bb49b57-1c86-47e6-8309-07b8622011e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.662544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134de3-c9c0-4e97-ab46-875eafdf62a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.667630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:50.681764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb49b57-1c86-47e6-8309-07b8622011e8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.687974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6e134de3-c9c0-4e97-ab46-875eafdf62a9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:50.689269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6e134de3-c9c0-4e97-ab46-875eafdf62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.745128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870577-5758-4238-af9e-dc06d5cc54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.745969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870577-5758-4238-af9e-dc06d5cc54f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.746253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870577-5758-4238-af9e-dc06d5cc54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.746531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870577-5758-4238-af9e-dc06d5cc54f5 admin admin] PATH_INFO: `/v3/projects/0d664a6787db46aa8342f212e2851eff/users/5e469ee72d404af8af89f718ab210adf/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.752986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1033/2042] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:50.753969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e134de3-c9c0-4e97-ab46-875eafdf62a9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.755314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6e134de3-c9c0-4e97-ab46-875eafdf62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.767206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb870577-5758-4238-af9e-dc06d5cc54f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d664a6787db46aa8342f212e2851eff, user_id=5e469ee72d404af8af89f718ab210adf, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.769295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e134de3-c9c0-4e97-ab46-875eafdf62a9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.769734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb870577-5758-4238-af9e-dc06d5cc54f5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.776812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4899605-5cde-419f-845b-657df4c4df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.776812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899605-5cde-419f-845b-657df4c4df1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.776812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899605-5cde-419f-845b-657df4c4df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.776812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899605-5cde-419f-845b-657df4c4df1d admin admin] PATH_INFO: `/v3/projects/9a22c6ef85ae4c9ebdeb05119a559e6a/users/80b2613e7bb74804b49a86d5fcbab513/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.779120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4899605-5cde-419f-845b-657df4c4df1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a22c6ef85ae4c9ebdeb05119a559e6a, user_id=80b2613e7bb74804b49a86d5fcbab513, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.781823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4899605-5cde-419f-845b-657df4c4df1d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.813105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1034/2043] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:50 2022] PUT /identity/v3/projects/9a22c6ef85ae4c9ebdeb05119a559e6a/users/80b2613e7bb74804b49a86d5fcbab513/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:50.813105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4899605-5cde-419f-845b-657df4c4df1d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.862297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1010/2044] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:50 2022] PUT /identity/v3/projects/0d664a6787db46aa8342f212e2851eff/users/5e469ee72d404af8af89f718ab210adf/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:50.863611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771785fb-c683-4c82-9a13-14ba45234f6e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.863904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771785fb-c683-4c82-9a13-14ba45234f6e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.864184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771785fb-c683-4c82-9a13-14ba45234f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.886107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4899605-5cde-419f-845b-657df4c4df1d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.895401 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-771785fb-c683-4c82-9a13-14ba45234f6e None None] MFA Rules not processed for user `a38b03fab5724b9da34145957c95e718`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:50.896638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-771785fb-c683-4c82-9a13-14ba45234f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:50.947617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac4c2c-7588-42b6-bef7-6318a49a7059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.948344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac4c2c-7588-42b6-bef7-6318a49a7059 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.948634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac4c2c-7588-42b6-bef7-6318a49a7059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.948915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac4c2c-7588-42b6-bef7-6318a49a7059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.949638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac4c2c-7588-42b6-bef7-6318a49a7059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.951221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac4c2c-7588-42b6-bef7-6318a49a7059 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.964853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1035/2045] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:50.964853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac4c2c-7588-42b6-bef7-6318a49a7059 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:50.972459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1011/2046] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:50.973861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814527a-3709-41cb-9cf5-bedc4aeabdc5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.974151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814527a-3709-41cb-9cf5-bedc4aeabdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.975213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac4c2c-7588-42b6-bef7-6318a49a7059 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:50.977235 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814527a-3709-41cb-9cf5-bedc4aeabdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.980666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d1609-429d-4cc9-bd37-d626dea7e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:50.981516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d1609-429d-4cc9-bd37-d626dea7e046 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:50.981799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d1609-429d-4cc9-bd37-d626dea7e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:50.982083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d1609-429d-4cc9-bd37-d626dea7e046 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:50.982807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d1609-429d-4cc9-bd37-d626dea7e046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:50.983120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d1609-429d-4cc9-bd37-d626dea7e046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:50.984747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d1609-429d-4cc9-bd37-d626dea7e046 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:50.999093 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1036/2047] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:51.000070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d1609-429d-4cc9-bd37-d626dea7e046 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.011345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d1609-429d-4cc9-bd37-d626dea7e046 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.016539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20be5d-3b3e-41be-b047-6b6a860b7812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.017206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20be5d-3b3e-41be-b047-6b6a860b7812 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.017490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20be5d-3b3e-41be-b047-6b6a860b7812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.017770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20be5d-3b3e-41be-b047-6b6a860b7812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.018534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20be5d-3b3e-41be-b047-6b6a860b7812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.020108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20be5d-3b3e-41be-b047-6b6a860b7812 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.025595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7814527a-3709-41cb-9cf5-bedc4aeabdc5 None None] MFA Rules not processed for user `80b2613e7bb74804b49a86d5fcbab513`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:51.027042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7814527a-3709-41cb-9cf5-bedc4aeabdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.031795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1037/2048] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:51.032873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20be5d-3b3e-41be-b047-6b6a860b7812 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.042723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20be5d-3b3e-41be-b047-6b6a860b7812 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.047452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2afaa9-4f13-4814-82af-132352cf81f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.048094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2afaa9-4f13-4814-82af-132352cf81f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.048411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2afaa9-4f13-4814-82af-132352cf81f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.048849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2afaa9-4f13-4814-82af-132352cf81f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.049398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2afaa9-4f13-4814-82af-132352cf81f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.050960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2afaa9-4f13-4814-82af-132352cf81f0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.061329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1038/2049] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:51.062380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2afaa9-4f13-4814-82af-132352cf81f0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.064813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9f2afaa9-4f13-4814-82af-132352cf81f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.077391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2afaa9-4f13-4814-82af-132352cf81f0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.082682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.083516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.083795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.084066 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] PATH_INFO: `/v3/projects/4dd4e6aa1fab47d0856c05dcc4efd7c7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.085290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd4e6aa1fab47d0856c05dcc4efd7c7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.090510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.098748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1012/2050] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:51.103038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814527a-3709-41cb-9cf5-bedc4aeabdc5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.112251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814527a-3709-41cb-9cf5-bedc4aeabdc5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.116900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5339b-65ff-4201-9b44-bd47b8a9aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.119151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5339b-65ff-4201-9b44-bd47b8a9aa7b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.119151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5339b-65ff-4201-9b44-bd47b8a9aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.119151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5339b-65ff-4201-9b44-bd47b8a9aa7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.119456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5339b-65ff-4201-9b44-bd47b8a9aa7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.121400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5339b-65ff-4201-9b44-bd47b8a9aa7b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.222887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd4e6aa1fab47d0856c05dcc4efd7c7', 'request_id': 'req-bc47d203-22ab-45d2-8e15-4214007b3661'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:51.226409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1013/2051] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:51 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:51.226409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5339b-65ff-4201-9b44-bd47b8a9aa7b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.283456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5339b-65ff-4201-9b44-bd47b8a9aa7b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.288172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c1803-3edc-4187-8c73-5e096e791f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.288857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c1803-3edc-4187-8c73-5e096e791f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.289655 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c1803-3edc-4187-8c73-5e096e791f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.289934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c1803-3edc-4187-8c73-5e096e791f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.290617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c1803-3edc-4187-8c73-5e096e791f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.292550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c1803-3edc-4187-8c73-5e096e791f86 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.319653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd4e6aa1fab47d0856c05dcc4efd7c7', 'request_id': 'req-bc47d203-22ab-45d2-8e15-4214007b3661'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:51.324838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd4e6aa1fab47d0856c05dcc4efd7c7', 'request_id': 'req-bc47d203-22ab-45d2-8e15-4214007b3661'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:51.336096 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] The token cache is being invalidate because project 4dd4e6aa1fab47d0856c05dcc4efd7c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:51.336938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:51.337080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:51.338635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1039/2052] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:51 2022] DELETE /identity/v3/projects/4dd4e6aa1fab47d0856c05dcc4efd7c7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:51.339434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.340859 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.401458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d203-22ab-45d2-8e15-4214007b3661 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.406107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be91d1-64d1-4cbb-ae6a-e8ecc2b8ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.406980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be91d1-64d1-4cbb-ae6a-e8ecc2b8ff7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.407104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1014/2053] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:51 2022] POST /identity/v3/projects => generated 389 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:51.407528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be91d1-64d1-4cbb-ae6a-e8ecc2b8ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.407528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be91d1-64d1-4cbb-ae6a-e8ecc2b8ff7b admin admin] PATH_INFO: `/v3/projects/0d664a6787db46aa8342f212e2851eff/users/5e469ee72d404af8af89f718ab210adf/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.407794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c1803-3edc-4187-8c73-5e096e791f86 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.409405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-076c1803-3edc-4187-8c73-5e096e791f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.409599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be91d1-64d1-4cbb-ae6a-e8ecc2b8ff7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d664a6787db46aa8342f212e2851eff, user_id=5e469ee72d404af8af89f718ab210adf, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.412400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be91d1-64d1-4cbb-ae6a-e8ecc2b8ff7b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.433987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1040/2054] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:51 2022] PUT /identity/v3/projects/0d664a6787db46aa8342f212e2851eff/users/5e469ee72d404af8af89f718ab210adf/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:51.433987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be91d1-64d1-4cbb-ae6a-e8ecc2b8ff7b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.435511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-37be91d1-64d1-4cbb-ae6a-e8ecc2b8ff7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.473908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c1803-3edc-4187-8c73-5e096e791f86 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.492715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be91d1-64d1-4cbb-ae6a-e8ecc2b8ff7b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.496814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.497578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.497920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.498203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.500107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.530508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a3bb9-3cdf-4703-87f8-936f4b12666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.531432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a3bb9-3cdf-4703-87f8-936f4b12666e admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.531694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a3bb9-3cdf-4703-87f8-936f4b12666e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.531969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a3bb9-3cdf-4703-87f8-936f4b12666e admin admin] PATH_INFO: `/v3/projects/cc88fea17ecd4b41a7183eae53162ba5/users/0413e7978b554cfba4902761836b8895/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.546871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a3bb9-3cdf-4703-87f8-936f4b12666e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc88fea17ecd4b41a7183eae53162ba5, user_id=0413e7978b554cfba4902761836b8895, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.549590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a3bb9-3cdf-4703-87f8-936f4b12666e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.564645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.566081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.578220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:51.578370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1041/2055] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:51.578370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.578370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.591022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c27b2-42f8-466c-8e40-118a1ad1735a service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.596952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c894ea-e7fd-40a2-80d9-a98f34abb663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.601346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c894ea-e7fd-40a2-80d9-a98f34abb663 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.601346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c894ea-e7fd-40a2-80d9-a98f34abb663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.601346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c894ea-e7fd-40a2-80d9-a98f34abb663 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.601346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c894ea-e7fd-40a2-80d9-a98f34abb663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.601346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c894ea-e7fd-40a2-80d9-a98f34abb663 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.656661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1015/2056] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:51 2022] PUT /identity/v3/projects/cc88fea17ecd4b41a7183eae53162ba5/users/0413e7978b554cfba4902761836b8895/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:51.657944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb2d1-ceb9-4875-9108-92a75c1d8abf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.658854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb2d1-ceb9-4875-9108-92a75c1d8abf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.658854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb2d1-ceb9-4875-9108-92a75c1d8abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.682279 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5dadb2d1-ceb9-4875-9108-92a75c1d8abf None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:51.682853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5dadb2d1-ceb9-4875-9108-92a75c1d8abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.702190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:51.743487 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1016/2057] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:51.744329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb2d1-ceb9-4875-9108-92a75c1d8abf None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.745590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5dadb2d1-ceb9-4875-9108-92a75c1d8abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.754862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1042/2058] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:51 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:51.756187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a938fcb-ca05-4486-b54d-a4fc0fc41565 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.756506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a938fcb-ca05-4486-b54d-a4fc0fc41565 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.756789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a938fcb-ca05-4486-b54d-a4fc0fc41565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.757230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb2d1-ceb9-4875-9108-92a75c1d8abf None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.761995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8cb7-647f-4d6b-b70a-9b41f3c0510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.762659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8cb7-647f-4d6b-b70a-9b41f3c0510b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.762941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8cb7-647f-4d6b-b70a-9b41f3c0510b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.763222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8cb7-647f-4d6b-b70a-9b41f3c0510b admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.763907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b8cb7-647f-4d6b-b70a-9b41f3c0510b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.765929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b8cb7-647f-4d6b-b70a-9b41f3c0510b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.783513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1a938fcb-ca05-4486-b54d-a4fc0fc41565 None None] MFA Rules not processed for user `5e469ee72d404af8af89f718ab210adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:51.784889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1a938fcb-ca05-4486-b54d-a4fc0fc41565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.852971 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1043/2059] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:51.854007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173fabb-df20-492c-b1f9-b14443ff27a6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.854307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173fabb-df20-492c-b1f9-b14443ff27a6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.854588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173fabb-df20-492c-b1f9-b14443ff27a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.857592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1017/2060] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:51 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:51.862590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8cb7-647f-4d6b-b70a-9b41f3c0510b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.862590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c45b8cb7-647f-4d6b-b70a-9b41f3c0510b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.872488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8cb7-647f-4d6b-b70a-9b41f3c0510b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.876302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f173fabb-df20-492c-b1f9-b14443ff27a6 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:51.877108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.877979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.878258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.878429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f173fabb-df20-492c-b1f9-b14443ff27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.878541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] PATH_INFO: `/v3/users/5397960e9f6a4770add9f384f9424c4d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.879698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5397960e9f6a4770add9f384f9424c4d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.881637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.886699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1044/2061] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:51.888372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364cdee-619b-4ac9-85b2-6cd45416b2e8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.888372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364cdee-619b-4ac9-85b2-6cd45416b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.888545 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364cdee-619b-4ac9-85b2-6cd45416b2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.906630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1364cdee-619b-4ac9-85b2-6cd45416b2e8 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:51.907822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1364cdee-619b-4ac9-85b2-6cd45416b2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:51.915633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1045/2062] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:51.919979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364cdee-619b-4ac9-85b2-6cd45416b2e8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:51.925567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364cdee-619b-4ac9-85b2-6cd45416b2e8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:51.930050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491e026-c439-44d1-bdc2-c951e14c8381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:51.930674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491e026-c439-44d1-bdc2-c951e14c8381 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:51.930960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491e026-c439-44d1-bdc2-c951e14c8381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:51.931238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491e026-c439-44d1-bdc2-c951e14c8381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:51.931956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491e026-c439-44d1-bdc2-c951e14c8381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:51.933566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491e026-c439-44d1-bdc2-c951e14c8381 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:51.943506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1046/2063] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:51.948668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491e026-c439-44d1-bdc2-c951e14c8381 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.001640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491e026-c439-44d1-bdc2-c951e14c8381 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.005561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e54820-64a7-4c3e-b5b3-6e97589535e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.008797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e54820-64a7-4c3e-b5b3-6e97589535e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.008797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e54820-64a7-4c3e-b5b3-6e97589535e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.008797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e54820-64a7-4c3e-b5b3-6e97589535e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.016986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e54820-64a7-4c3e-b5b3-6e97589535e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.019022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e54820-64a7-4c3e-b5b3-6e97589535e5 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.028681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1047/2064] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:52.029493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e54820-64a7-4c3e-b5b3-6e97589535e5 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.040659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e54820-64a7-4c3e-b5b3-6e97589535e5 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.044836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb8b5f-2788-4151-a484-87acd3cd2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.045506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8b5f-2788-4151-a484-87acd3cd2c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.045978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8b5f-2788-4151-a484-87acd3cd2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.046270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8b5f-2788-4151-a484-87acd3cd2c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.047550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb8b5f-2788-4151-a484-87acd3cd2c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.049271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb8b5f-2788-4151-a484-87acd3cd2c85 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.059818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1048/2065] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:52.063574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb8b5f-2788-4151-a484-87acd3cd2c85 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.063574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e9bb8b5f-2788-4151-a484-87acd3cd2c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:52.078189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5397960e9f6a4770add9f384f9424c4d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:52.085928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5397960e9f6a4770add9f384f9424c4d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:52.087485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5397960e9f6a4770add9f384f9424c4d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:52.099868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5397960e9f6a4770add9f384f9424c4d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:52.134643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb8b5f-2788-4151-a484-87acd3cd2c85 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.138283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db3b6e-3ec9-404a-b02d-e1d87c670fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.138935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db3b6e-3ec9-404a-b02d-e1d87c670fef service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.139222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db3b6e-3ec9-404a-b02d-e1d87c670fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.139504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db3b6e-3ec9-404a-b02d-e1d87c670fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.151283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db3b6e-3ec9-404a-b02d-e1d87c670fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.152780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db3b6e-3ec9-404a-b02d-e1d87c670fef service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.162408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1049/2066] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:52.163206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db3b6e-3ec9-404a-b02d-e1d87c670fef service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.172458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db3b6e-3ec9-404a-b02d-e1d87c670fef service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.177145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047e1a9-1e7d-4fd1-826e-2c5c6de18bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.179631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047e1a9-1e7d-4fd1-826e-2c5c6de18bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.179631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047e1a9-1e7d-4fd1-826e-2c5c6de18bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.179631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047e1a9-1e7d-4fd1-826e-2c5c6de18bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.179631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047e1a9-1e7d-4fd1-826e-2c5c6de18bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:52.179631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047e1a9-1e7d-4fd1-826e-2c5c6de18bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.181612 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047e1a9-1e7d-4fd1-826e-2c5c6de18bf5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.193632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1050/2067] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:52.194391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047e1a9-1e7d-4fd1-826e-2c5c6de18bf5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.198607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5397960e9f6a4770add9f384f9424c4d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:52.204741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047e1a9-1e7d-4fd1-826e-2c5c6de18bf5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.205951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1018/2068] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:51 2022] DELETE /identity/v3/users/5397960e9f6a4770add9f384f9424c4d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:52.209920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.211019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:52.266316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618ec96-f803-4cd6-b68e-82a94c128cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.267227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618ec96-f803-4cd6-b68e-82a94c128cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.267546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618ec96-f803-4cd6-b68e-82a94c128cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.267787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618ec96-f803-4cd6-b68e-82a94c128cd8 admin admin] PATH_INFO: `/v3/projects/1cf26c04bfe54eedb22a70017188674b/users/b003ea1970114ae38530b9a5a1fa077b/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.281482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be50733-47f7-4f48-a343-db289686ae2f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.285450 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618ec96-f803-4cd6-b68e-82a94c128cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf26c04bfe54eedb22a70017188674b, user_id=b003ea1970114ae38530b9a5a1fa077b, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.287289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e88196-6f37-4262-99cf-98d335712254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.288045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e88196-6f37-4262-99cf-98d335712254 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.288156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618ec96-f803-4cd6-b68e-82a94c128cd8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.288470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e88196-6f37-4262-99cf-98d335712254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.288832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e88196-6f37-4262-99cf-98d335712254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.289697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e88196-6f37-4262-99cf-98d335712254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.292107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e88196-6f37-4262-99cf-98d335712254 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.302696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1019/2069] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:52.303514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e88196-6f37-4262-99cf-98d335712254 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.305844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-89e88196-6f37-4262-99cf-98d335712254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:52.318928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e88196-6f37-4262-99cf-98d335712254 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.324696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8c78-6aa8-433f-adcc-a6f367988de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.325359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8c78-6aa8-433f-adcc-a6f367988de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.325642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8c78-6aa8-433f-adcc-a6f367988de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.325915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8c78-6aa8-433f-adcc-a6f367988de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.326592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa8c78-6aa8-433f-adcc-a6f367988de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.328565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa8c78-6aa8-433f-adcc-a6f367988de8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.365862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1051/2070] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:52 2022] PUT /identity/v3/projects/1cf26c04bfe54eedb22a70017188674b/users/b003ea1970114ae38530b9a5a1fa077b/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:52.367746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d9392-e389-4383-a12a-86edd2b4292a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.368049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d9392-e389-4383-a12a-86edd2b4292a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.368339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d9392-e389-4383-a12a-86edd2b4292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.385939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-463d9392-e389-4383-a12a-86edd2b4292a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:52.387077 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-463d9392-e389-4383-a12a-86edd2b4292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:52.443955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1020/2071] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:52 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:52.444833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8c78-6aa8-433f-adcc-a6f367988de8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.454880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1052/2072] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:52.454880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d9392-e389-4383-a12a-86edd2b4292a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.464821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-463d9392-e389-4383-a12a-86edd2b4292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:52.480271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d9392-e389-4383-a12a-86edd2b4292a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.516888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8c78-6aa8-433f-adcc-a6f367988de8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.523365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20267b-0929-4eb6-b741-d298e8f39ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.524804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20267b-0929-4eb6-b741-d298e8f39ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.525246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20267b-0929-4eb6-b741-d298e8f39ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.525376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20267b-0929-4eb6-b741-d298e8f39ebf admin admin] PATH_INFO: `/v3/projects/597d293d24fc4c6a92ac537cefd258a7/users/53490cc482c149eaa28f80b868dba094/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.545847 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20267b-0929-4eb6-b741-d298e8f39ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=597d293d24fc4c6a92ac537cefd258a7, user_id=53490cc482c149eaa28f80b868dba094, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.546338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129de7bc-0659-4613-9d72-a543911452f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.547314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129de7bc-0659-4613-9d72-a543911452f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.547808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129de7bc-0659-4613-9d72-a543911452f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.548411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129de7bc-0659-4613-9d72-a543911452f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.548810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20267b-0929-4eb6-b741-d298e8f39ebf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.549343 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129de7bc-0659-4613-9d72-a543911452f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.551067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129de7bc-0659-4613-9d72-a543911452f5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.564468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1053/2073] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:52.564468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129de7bc-0659-4613-9d72-a543911452f5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.583511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129de7bc-0659-4613-9d72-a543911452f5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.588580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a317da7-c588-4064-a807-fd71297a9d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.589098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:52.589440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a317da7-c588-4064-a807-fd71297a9d9d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.589734 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a317da7-c588-4064-a807-fd71297a9d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.590054 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a317da7-c588-4064-a807-fd71297a9d9d admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.590750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a317da7-c588-4064-a807-fd71297a9d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.593045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a317da7-c588-4064-a807-fd71297a9d9d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.613041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1021/2074] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:52 2022] PUT /identity/v3/projects/597d293d24fc4c6a92ac537cefd258a7/users/53490cc482c149eaa28f80b868dba094/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:52.619649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20267b-0929-4eb6-b741-d298e8f39ebf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.619649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fc20267b-0929-4eb6-b741-d298e8f39ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:52.673685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20267b-0929-4eb6-b741-d298e8f39ebf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.677241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8b955-3913-4937-9e8f-e31fbcf90cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.682221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8b955-3913-4937-9e8f-e31fbcf90cec service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.682221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8b955-3913-4937-9e8f-e31fbcf90cec service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.682221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8b955-3913-4937-9e8f-e31fbcf90cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.704996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:52.715831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1054/2075] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:52 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:52.717023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a317da7-c588-4064-a807-fd71297a9d9d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.729882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a317da7-c588-4064-a807-fd71297a9d9d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.767217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8b955-3913-4937-9e8f-e31fbcf90cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.774949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8b955-3913-4937-9e8f-e31fbcf90cec service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.802114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1022/2076] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:52.803512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677faf8-bb24-40d6-bdd6-f8e7fd306a17 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.803808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677faf8-bb24-40d6-bdd6-f8e7fd306a17 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.804475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677faf8-bb24-40d6-bdd6-f8e7fd306a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.814308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330332b8-407f-401b-97be-67b7934f9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.815780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330332b8-407f-401b-97be-67b7934f9a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.816251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330332b8-407f-401b-97be-67b7934f9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.816987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330332b8-407f-401b-97be-67b7934f9a6c admin admin] PATH_INFO: `/v3/projects/1cf26c04bfe54eedb22a70017188674b/users/b003ea1970114ae38530b9a5a1fa077b/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.820604 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330332b8-407f-401b-97be-67b7934f9a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf26c04bfe54eedb22a70017188674b, user_id=b003ea1970114ae38530b9a5a1fa077b, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.824342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330332b8-407f-401b-97be-67b7934f9a6c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.825972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b677faf8-bb24-40d6-bdd6-f8e7fd306a17 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:52.827023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b677faf8-bb24-40d6-bdd6-f8e7fd306a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:52.835706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1023/2077] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:52.837790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677faf8-bb24-40d6-bdd6-f8e7fd306a17 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.848406 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1055/2078] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:52 2022] PUT /identity/v3/projects/1cf26c04bfe54eedb22a70017188674b/users/b003ea1970114ae38530b9a5a1fa077b/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:52.851041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677faf8-bb24-40d6-bdd6-f8e7fd306a17 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.854024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330332b8-407f-401b-97be-67b7934f9a6c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:52.916742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330332b8-407f-401b-97be-67b7934f9a6c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:52.922619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d25249-2fd0-48f5-a46d-bcdf98adf7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.923276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d25249-2fd0-48f5-a46d-bcdf98adf7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.923819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d25249-2fd0-48f5-a46d-bcdf98adf7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.924126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d25249-2fd0-48f5-a46d-bcdf98adf7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.942714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e724a-5326-41dc-b5e8-1b52b0cb958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:52.942714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e724a-5326-41dc-b5e8-1b52b0cb958e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.942714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e724a-5326-41dc-b5e8-1b52b0cb958e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.942714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e724a-5326-41dc-b5e8-1b52b0cb958e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.943722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e724a-5326-41dc-b5e8-1b52b0cb958e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:52.943722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e724a-5326-41dc-b5e8-1b52b0cb958e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:52.955632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1024/2079] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:52.957069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69537fd-9956-4942-9ec0-367f289b3906 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:52.957357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69537fd-9956-4942-9ec0-367f289b3906 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:52.957638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69537fd-9956-4942-9ec0-367f289b3906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:52.963516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:52.992576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a69537fd-9956-4942-9ec0-367f289b3906 None None] MFA Rules not processed for user `b003ea1970114ae38530b9a5a1fa077b`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:52.993528 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a69537fd-9956-4942-9ec0-367f289b3906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:53.020880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d25249-2fd0-48f5-a46d-bcdf98adf7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:53.022977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d25249-2fd0-48f5-a46d-bcdf98adf7a4 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:53.034937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1056/2080] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:53.035772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d25249-2fd0-48f5-a46d-bcdf98adf7a4 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:53.046222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d25249-2fd0-48f5-a46d-bcdf98adf7a4 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:53.051262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dafb8b-7981-43b8-8000-15512961ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:53.051912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dafb8b-7981-43b8-8000-15512961ec6b admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.052225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dafb8b-7981-43b8-8000-15512961ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.054292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dafb8b-7981-43b8-8000-15512961ec6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.054292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dafb8b-7981-43b8-8000-15512961ec6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:53.055002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dafb8b-7981-43b8-8000-15512961ec6b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:53.065904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1057/2081] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:53.069888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dafb8b-7981-43b8-8000-15512961ec6b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:53.074464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1025/2082] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:53.082498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dafb8b-7981-43b8-8000-15512961ec6b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:53.086741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69537fd-9956-4942-9ec0-367f289b3906 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:53.088516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d87ec7-7db2-4467-91f1-8ef9cc298f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:53.088816 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a69537fd-9956-4942-9ec0-367f289b3906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:53.089663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d87ec7-7db2-4467-91f1-8ef9cc298f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.089963 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d87ec7-7db2-4467-91f1-8ef9cc298f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.090231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d87ec7-7db2-4467-91f1-8ef9cc298f3d admin admin] PATH_INFO: `/v3/projects/2413b4952f614e9cb13874e14e73345f/users/2b2feeae716a4f0899a6a914cb603bca/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.113708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d87ec7-7db2-4467-91f1-8ef9cc298f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2413b4952f614e9cb13874e14e73345f, user_id=2b2feeae716a4f0899a6a914cb603bca, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:53.116657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d87ec7-7db2-4467-91f1-8ef9cc298f3d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:53.165833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69537fd-9956-4942-9ec0-367f289b3906 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:53.169669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5d60b-4ede-43bc-b89f-0f4b5b3d759a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:53.170496 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5d60b-4ede-43bc-b89f-0f4b5b3d759a service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.170784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5d60b-4ede-43bc-b89f-0f4b5b3d759a service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.171071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5d60b-4ede-43bc-b89f-0f4b5b3d759a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.189447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5d60b-4ede-43bc-b89f-0f4b5b3d759a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:53.189447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5d60b-4ede-43bc-b89f-0f4b5b3d759a service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:53.200794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1026/2083] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:53.217308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1058/2084] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:53 2022] PUT /identity/v3/projects/2413b4952f614e9cb13874e14e73345f/users/2b2feeae716a4f0899a6a914cb603bca/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:53.219412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2240f-3008-4b74-96aa-53a5fd562ad8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.219906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2240f-3008-4b74-96aa-53a5fd562ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.220665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2240f-3008-4b74-96aa-53a5fd562ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.247444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ade2240f-3008-4b74-96aa-53a5fd562ad8 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:53.249207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ade2240f-3008-4b74-96aa-53a5fd562ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:53.328852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d87ec7-7db2-4467-91f1-8ef9cc298f3d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:53.343358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1027/2085] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:53.344954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2240f-3008-4b74-96aa-53a5fd562ad8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:53.346616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ade2240f-3008-4b74-96aa-53a5fd562ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:53.364722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2240f-3008-4b74-96aa-53a5fd562ad8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:53.371627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:53.379188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.379188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.379188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] PATH_INFO: `/v3/users/0be8c324676b471584a7a26f31e6a37b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.379188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be8c324676b471584a7a26f31e6a37b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:53.379188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:53.422099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d87ec7-7db2-4467-91f1-8ef9cc298f3d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:53.431418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d85f3d-7c52-4bf0-870b-55bafd564a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:53.431418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85f3d-7c52-4bf0-870b-55bafd564a7f service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.431418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85f3d-7c52-4bf0-870b-55bafd564a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.431418 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85f3d-7c52-4bf0-870b-55bafd564a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.432486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e6d85f3d-7c52-4bf0-870b-55bafd564a7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:53.508823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d85f3d-7c52-4bf0-870b-55bafd564a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:53.510250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d85f3d-7c52-4bf0-870b-55bafd564a7f service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:53.518927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1059/2086] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:23:53.519695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d85f3d-7c52-4bf0-870b-55bafd564a7f service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:53.594889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d85f3d-7c52-4bf0-870b-55bafd564a7f service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:53.600892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cd624-4069-4378-82ce-b218a9f2e193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:53.601835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cd624-4069-4378-82ce-b218a9f2e193 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.602306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cd624-4069-4378-82ce-b218a9f2e193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.602732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cd624-4069-4378-82ce-b218a9f2e193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.615865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5cd624-4069-4378-82ce-b218a9f2e193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:53.617621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5cd624-4069-4378-82ce-b218a9f2e193 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:53.620710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be8c324676b471584a7a26f31e6a37b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.628542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:53.629392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1060/2087] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:53.630229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cd624-4069-4378-82ce-b218a9f2e193 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:53.631180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be8c324676b471584a7a26f31e6a37b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.632095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be8c324676b471584a7a26f31e6a37b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.633972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2a5cd624-4069-4378-82ce-b218a9f2e193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:53.648057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be8c324676b471584a7a26f31e6a37b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.665909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cd624-4069-4378-82ce-b218a9f2e193 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:53.675749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:53.677156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.679384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.680372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] PATH_INFO: `/v3/projects/8e17dd84314d4ae0a76614262becbda3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.681745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e17dd84314d4ae0a76614262becbda3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:53.683655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:53.714050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6601e05e-5af6-4b0a-859c-dff43899906d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be8c324676b471584a7a26f31e6a37b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.722156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1028/2088] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:53 2022] DELETE /identity/v3/users/0be8c324676b471584a7a26f31e6a37b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:53.726943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0741f-f59a-4fa1-a96b-aaa822aa9f4c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.727444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0741f-f59a-4fa1-a96b-aaa822aa9f4c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.727949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0741f-f59a-4fa1-a96b-aaa822aa9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.746479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-85f0741f-f59a-4fa1-a96b-aaa822aa9f4c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:53.750112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-85f0741f-f59a-4fa1-a96b-aaa822aa9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:53.835593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e17dd84314d4ae0a76614262becbda3', 'request_id': 'req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.856262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1029/2089] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:53.856262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df691a-47e8-409a-869e-393a0cc5776a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:53.856262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df691a-47e8-409a-869e-393a0cc5776a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:53.856262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df691a-47e8-409a-869e-393a0cc5776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:53.884964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f0df691a-47e8-409a-869e-393a0cc5776a None None] MFA Rules not processed for user `0413e7978b554cfba4902761836b8895`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:53.886278 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f0df691a-47e8-409a-869e-393a0cc5776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:53.932933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e17dd84314d4ae0a76614262becbda3', 'request_id': 'req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.941448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e17dd84314d4ae0a76614262becbda3', 'request_id': 'req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.958347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] The token cache is being invalidate because project 8e17dd84314d4ae0a76614262becbda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:53.958628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.959428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:53.964122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1061/2090] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:53 2022] DELETE /identity/v3/projects/8e17dd84314d4ae0a76614262becbda3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:53.964122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:53.964836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:53.978902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1030/2091] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:53.979584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df691a-47e8-409a-869e-393a0cc5776a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:53.980903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f0df691a-47e8-409a-869e-393a0cc5776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:54.039429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12ba94-fbae-4c5a-87f8-ffa68b15e445 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:54.046202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:54.049365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:54.049365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:54.049365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:54.049887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:54.057693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df691a-47e8-409a-869e-393a0cc5776a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:54.063118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:54.063577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:54.065063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:54.065182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:54.065290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:54.065587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] PATH_INFO: `/v3/users/80b2613e7bb74804b49a86d5fcbab513` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:54.066906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=80b2613e7bb74804b49a86d5fcbab513)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:54.069168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:54.078178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1062/2092] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:54.078178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:54.078178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:54.141732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bb123-3bd1-48e7-afad-e3edba5ea45d service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:54.146144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f819f4-29fd-444d-ac7b-fe31c455da72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:54.146895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f819f4-29fd-444d-ac7b-fe31c455da72 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:54.147284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f819f4-29fd-444d-ac7b-fe31c455da72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:54.147671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f819f4-29fd-444d-ac7b-fe31c455da72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:54.164726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f819f4-29fd-444d-ac7b-fe31c455da72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:54.164726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f819f4-29fd-444d-ac7b-fe31c455da72 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:54.170014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1063/2093] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:54.310211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80b2613e7bb74804b49a86d5fcbab513'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:54.322826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80b2613e7bb74804b49a86d5fcbab513'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:54.328924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80b2613e7bb74804b49a86d5fcbab513'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:54.342675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80b2613e7bb74804b49a86d5fcbab513'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:54.378308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:54.463215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80b2613e7bb74804b49a86d5fcbab513'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:54.479049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1031/2094] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:53 2022] DELETE /identity/v3/users/80b2613e7bb74804b49a86d5fcbab513 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:54.608219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f819f4-29fd-444d-ac7b-fe31c455da72 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:54.610629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-34f819f4-29fd-444d-ac7b-fe31c455da72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:54.635463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f819f4-29fd-444d-ac7b-fe31c455da72 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:54.724949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:54.725936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:54.726229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:54.726512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] PATH_INFO: `/v3/projects/fe64f4356ddc49c5ad6bdad68feddf02` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:54.728274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe64f4356ddc49c5ad6bdad68feddf02)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:54.730242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:54.860080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe64f4356ddc49c5ad6bdad68feddf02', 'request_id': 'req-f312f90c-c28e-42c2-a563-ac91ca2b8d15'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:54.994016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe64f4356ddc49c5ad6bdad68feddf02', 'request_id': 'req-f312f90c-c28e-42c2-a563-ac91ca2b8d15'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.001045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe64f4356ddc49c5ad6bdad68feddf02', 'request_id': 'req-f312f90c-c28e-42c2-a563-ac91ca2b8d15'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.013560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] The token cache is being invalidate because project fe64f4356ddc49c5ad6bdad68feddf02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:55.013861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.015051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.016577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1064/2095] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:54 2022] DELETE /identity/v3/projects/fe64f4356ddc49c5ad6bdad68feddf02 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:55.021088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:55.022653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:55.051555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c129a-ac21-4a3f-9683-e5eba5cebbcf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:55.156383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:55.158149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:55.161466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:55.162362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:55.162647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:55.162925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] PATH_INFO: `/v3/users/5e469ee72d404af8af89f718ab210adf` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:55.164168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e469ee72d404af8af89f718ab210adf)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:55.166196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:55.173787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312f90c-c28e-42c2-a563-ac91ca2b8d15 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:55.179204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:55.180956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:55.181404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:55.181783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] PATH_INFO: `/v3/projects/9a22c6ef85ae4c9ebdeb05119a559e6a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:55.183130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a22c6ef85ae4c9ebdeb05119a559e6a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:55.185423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:55.317792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a22c6ef85ae4c9ebdeb05119a559e6a', 'request_id': 'req-2ecc1495-942a-4d16-be44-281bd807d34e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.396632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e469ee72d404af8af89f718ab210adf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.404280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e469ee72d404af8af89f718ab210adf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.405199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e469ee72d404af8af89f718ab210adf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.416564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a22c6ef85ae4c9ebdeb05119a559e6a', 'request_id': 'req-2ecc1495-942a-4d16-be44-281bd807d34e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.423896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a22c6ef85ae4c9ebdeb05119a559e6a', 'request_id': 'req-2ecc1495-942a-4d16-be44-281bd807d34e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.427038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e469ee72d404af8af89f718ab210adf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.440534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] The token cache is being invalidate because project 9a22c6ef85ae4c9ebdeb05119a559e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:55.440534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.440534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ecc1495-942a-4d16-be44-281bd807d34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.440534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1065/2096] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:55 2022] DELETE /identity/v3/projects/9a22c6ef85ae4c9ebdeb05119a559e6a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:55.445351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d3a9-53ee-4ecf-a3dd-dc2cbe416320 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:55.446390 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d3a9-53ee-4ecf-a3dd-dc2cbe416320 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:55.446764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d3a9-53ee-4ecf-a3dd-dc2cbe416320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:55.467111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-efc9d3a9-53ee-4ecf-a3dd-dc2cbe416320 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:55.468491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-efc9d3a9-53ee-4ecf-a3dd-dc2cbe416320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:55.510119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b212cdd-11b1-404a-801a-b1b6bda7b3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e469ee72d404af8af89f718ab210adf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:55.521607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1032/2097] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:55 2022] DELETE /identity/v3/users/5e469ee72d404af8af89f718ab210adf => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:55.521607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546812b0-8017-43a4-bb9e-279a553a8d52 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:55.521607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546812b0-8017-43a4-bb9e-279a553a8d52 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:55.521607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546812b0-8017-43a4-bb9e-279a553a8d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:55.569688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-546812b0-8017-43a4-bb9e-279a553a8d52 None None] MFA Rules not processed for user `2b2feeae716a4f0899a6a914cb603bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:55.571731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-546812b0-8017-43a4-bb9e-279a553a8d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:55.591937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1066/2098] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:55.599577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba04ea-3782-4592-91cb-74bdd11a063a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:55.599937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba04ea-3782-4592-91cb-74bdd11a063a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:55.600294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba04ea-3782-4592-91cb-74bdd11a063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:55.621703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-98ba04ea-3782-4592-91cb-74bdd11a063a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:55.623011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-98ba04ea-3782-4592-91cb-74bdd11a063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:55.693377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1067/2099] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:55.694658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba04ea-3782-4592-91cb-74bdd11a063a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:55.712688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1033/2100] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:55.717179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546812b0-8017-43a4-bb9e-279a553a8d52 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:55.718844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-546812b0-8017-43a4-bb9e-279a553a8d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:55.728064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba04ea-3782-4592-91cb-74bdd11a063a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:55.744067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb5a63-e135-4cc0-969b-f0b7e7b60950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:55.744775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb5a63-e135-4cc0-969b-f0b7e7b60950 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:55.745051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb5a63-e135-4cc0-969b-f0b7e7b60950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:55.745328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb5a63-e135-4cc0-969b-f0b7e7b60950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:55.749568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb5a63-e135-4cc0-969b-f0b7e7b60950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:55.762714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb5a63-e135-4cc0-969b-f0b7e7b60950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:55.763489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546812b0-8017-43a4-bb9e-279a553a8d52 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:55.763569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb5a63-e135-4cc0-969b-f0b7e7b60950 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:55.766588 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b5a5-39e6-46fc-8071-df0d4ee2a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:55.767273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b5a5-39e6-46fc-8071-df0d4ee2a7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:55.768056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b5a5-39e6-46fc-8071-df0d4ee2a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:55.768359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b5a5-39e6-46fc-8071-df0d4ee2a7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:55.769072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9b5a5-39e6-46fc-8071-df0d4ee2a7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:55.780063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9b5a5-39e6-46fc-8071-df0d4ee2a7eb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:55.786819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1068/2101] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:55.795084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb5a63-e135-4cc0-969b-f0b7e7b60950 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:55.814875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb5a63-e135-4cc0-969b-f0b7e7b60950 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:55.820060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4338ee9-04a8-4427-8de6-8bde2442b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:55.820815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4338ee9-04a8-4427-8de6-8bde2442b59f admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:55.821100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4338ee9-04a8-4427-8de6-8bde2442b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:55.821385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4338ee9-04a8-4427-8de6-8bde2442b59f admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:55.822372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4338ee9-04a8-4427-8de6-8bde2442b59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:55.824583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4338ee9-04a8-4427-8de6-8bde2442b59f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:55.853430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:55.895711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1034/2102] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:55 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:55.900649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b5a5-39e6-46fc-8071-df0d4ee2a7eb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:55.912521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1069/2103] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:55 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:55.917346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4338ee9-04a8-4427-8de6-8bde2442b59f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:55.969639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b5a5-39e6-46fc-8071-df0d4ee2a7eb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:55.993778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4338ee9-04a8-4427-8de6-8bde2442b59f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.015972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025ff7c-c15c-4fbc-bb20-e5bcb565706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.017005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025ff7c-c15c-4fbc-bb20-e5bcb565706b admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.017434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025ff7c-c15c-4fbc-bb20-e5bcb565706b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.017833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025ff7c-c15c-4fbc-bb20-e5bcb565706b admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.019098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025ff7c-c15c-4fbc-bb20-e5bcb565706b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.022683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025ff7c-c15c-4fbc-bb20-e5bcb565706b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.091362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7682d6a-5cc5-49bd-bc9c-8462a7828f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.092696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7682d6a-5cc5-49bd-bc9c-8462a7828f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.093174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7682d6a-5cc5-49bd-bc9c-8462a7828f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.094166 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7682d6a-5cc5-49bd-bc9c-8462a7828f6c admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.095562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7682d6a-5cc5-49bd-bc9c-8462a7828f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.097801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7682d6a-5cc5-49bd-bc9c-8462a7828f6c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.113125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1070/2104] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:55 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:56.114665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd983b0-fc9f-47ae-b6e3-28f49327a3fe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.115227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd983b0-fc9f-47ae-b6e3-28f49327a3fe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.116482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd983b0-fc9f-47ae-b6e3-28f49327a3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.135845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4cd983b0-fc9f-47ae-b6e3-28f49327a3fe None None] MFA Rules not processed for user `0413e7978b554cfba4902761836b8895`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:56.137732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4cd983b0-fc9f-47ae-b6e3-28f49327a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:56.193648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1035/2105] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:55 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:56.195021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7682d6a-5cc5-49bd-bc9c-8462a7828f6c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:56.205442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1071/2106] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:56.207877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd983b0-fc9f-47ae-b6e3-28f49327a3fe None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:56.222836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd983b0-fc9f-47ae-b6e3-28f49327a3fe None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.225559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7682d6a-5cc5-49bd-bc9c-8462a7828f6c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.229313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a1492-f1b6-4b11-ae18-d51bb6c35bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.230172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a1492-f1b6-4b11-ae18-d51bb6c35bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.230530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a1492-f1b6-4b11-ae18-d51bb6c35bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.230944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a1492-f1b6-4b11-ae18-d51bb6c35bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.231748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a1492-f1b6-4b11-ae18-d51bb6c35bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.233538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a1492-f1b6-4b11-ae18-d51bb6c35bc8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.234251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058ac41-07ac-4e22-9c75-324a1edf777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.235112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058ac41-07ac-4e22-9c75-324a1edf777d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.235495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058ac41-07ac-4e22-9c75-324a1edf777d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.235871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058ac41-07ac-4e22-9c75-324a1edf777d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.239214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058ac41-07ac-4e22-9c75-324a1edf777d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.242330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058ac41-07ac-4e22-9c75-324a1edf777d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.248286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1072/2107] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:56.257041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a1492-f1b6-4b11-ae18-d51bb6c35bc8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:56.280717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1036/2108] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:56.284252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a1492-f1b6-4b11-ae18-d51bb6c35bc8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.285362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058ac41-07ac-4e22-9c75-324a1edf777d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:56.317276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80293e6-b078-431a-aef4-229fb51bb23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.318457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80293e6-b078-431a-aef4-229fb51bb23c admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.318689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80293e6-b078-431a-aef4-229fb51bb23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.318966 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80293e6-b078-431a-aef4-229fb51bb23c admin admin] PATH_INFO: `/v3/projects/0912dcc2043e4ae99b28f070018d7aee/users/dddeab201f17411998952f405f0ee47d/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.335477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058ac41-07ac-4e22-9c75-324a1edf777d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.363109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee95cfc-99f4-4613-877f-51b688ce49e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.364043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee95cfc-99f4-4613-877f-51b688ce49e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.364716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee95cfc-99f4-4613-877f-51b688ce49e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.364969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee95cfc-99f4-4613-877f-51b688ce49e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.365720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee95cfc-99f4-4613-877f-51b688ce49e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.373108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee95cfc-99f4-4613-877f-51b688ce49e1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.395240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80293e6-b078-431a-aef4-229fb51bb23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0912dcc2043e4ae99b28f070018d7aee, user_id=dddeab201f17411998952f405f0ee47d, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.400234 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80293e6-b078-431a-aef4-229fb51bb23c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.411715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1037/2109] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:56.412815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee95cfc-99f4-4613-877f-51b688ce49e1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:56.430093 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee95cfc-99f4-4613-877f-51b688ce49e1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.442880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9b53-0ca4-4b18-baa9-a96dd80a1113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.444010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9b53-0ca4-4b18-baa9-a96dd80a1113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.446150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9b53-0ca4-4b18-baa9-a96dd80a1113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.447745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9b53-0ca4-4b18-baa9-a96dd80a1113 admin admin] PATH_INFO: `/v3/projects/8ee74e60d08b4c2192ce78726aeba128/users/3715f6452c0548a691a1596f6390dc65/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.477181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9b53-0ca4-4b18-baa9-a96dd80a1113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee74e60d08b4c2192ce78726aeba128, user_id=3715f6452c0548a691a1596f6390dc65, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.480000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9b53-0ca4-4b18-baa9-a96dd80a1113 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.495356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1073/2110] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:56 2022] PUT /identity/v3/projects/0912dcc2043e4ae99b28f070018d7aee/users/dddeab201f17411998952f405f0ee47d/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:56.499087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80293e6-b078-431a-aef4-229fb51bb23c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:56.581185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80293e6-b078-431a-aef4-229fb51bb23c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.588394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a63d78-f44e-4196-8883-680c4091c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.589142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a63d78-f44e-4196-8883-680c4091c745 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.589501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a63d78-f44e-4196-8883-680c4091c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.589852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a63d78-f44e-4196-8883-680c4091c745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.590651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a63d78-f44e-4196-8883-680c4091c745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.592379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a63d78-f44e-4196-8883-680c4091c745 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.601185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1038/2111] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:56 2022] PUT /identity/v3/projects/8ee74e60d08b4c2192ce78726aeba128/users/3715f6452c0548a691a1596f6390dc65/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:56.608487 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d985-5688-4650-afd4-df084a8b2e75 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.609030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d985-5688-4650-afd4-df084a8b2e75 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.610234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d985-5688-4650-afd4-df084a8b2e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.616363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1074/2112] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:23:56.619112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a63d78-f44e-4196-8883-680c4091c745 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:56.631525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a63d78-f44e-4196-8883-680c4091c745 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.650416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-01d2d985-5688-4650-afd4-df084a8b2e75 None None] MFA Rules not processed for user `3715f6452c0548a691a1596f6390dc65`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:56.651954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-01d2d985-5688-4650-afd4-df084a8b2e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:56.681391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:56.708049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcf421-6264-4cb6-a3e3-4e0c73a494aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.709106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcf421-6264-4cb6-a3e3-4e0c73a494aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.709513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcf421-6264-4cb6-a3e3-4e0c73a494aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.710133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcf421-6264-4cb6-a3e3-4e0c73a494aa admin admin] PATH_INFO: `/v3/projects/0912dcc2043e4ae99b28f070018d7aee/users/dddeab201f17411998952f405f0ee47d/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.712689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcf421-6264-4cb6-a3e3-4e0c73a494aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0912dcc2043e4ae99b28f070018d7aee, user_id=dddeab201f17411998952f405f0ee47d, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.715470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcf421-6264-4cb6-a3e3-4e0c73a494aa admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.734846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1075/2113] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:56 2022] PUT /identity/v3/projects/0912dcc2043e4ae99b28f070018d7aee/users/dddeab201f17411998952f405f0ee47d/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:56.735854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcf421-6264-4cb6-a3e3-4e0c73a494aa admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:56.739245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-18bcf421-6264-4cb6-a3e3-4e0c73a494aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:56.780354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1039/2114] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:56.785142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2d985-5688-4650-afd4-df084a8b2e75 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:56.820165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2d985-5688-4650-afd4-df084a8b2e75 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.837098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcf421-6264-4cb6-a3e3-4e0c73a494aa admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:56.842285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.843558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.843852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.844135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] PATH_INFO: `/v3/projects/0d664a6787db46aa8342f212e2851eff` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.845736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d664a6787db46aa8342f212e2851eff)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.847613 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:56.886130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada995b1-fe5b-4e0f-9822-15ffffaa027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:56.886778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada995b1-fe5b-4e0f-9822-15ffffaa027b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:56.887121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada995b1-fe5b-4e0f-9822-15ffffaa027b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:56.887404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada995b1-fe5b-4e0f-9822-15ffffaa027b admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:56.888160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada995b1-fe5b-4e0f-9822-15ffffaa027b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:56.890170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada995b1-fe5b-4e0f-9822-15ffffaa027b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:57.000496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d664a6787db46aa8342f212e2851eff', 'request_id': 'req-d3753bea-8dfa-4f5b-89b6-392545b4da77'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.015360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1040/2115] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:56 2022] POST /identity/v3/projects => generated 365 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:57.016067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada995b1-fe5b-4e0f-9822-15ffffaa027b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:57.021182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ada995b1-fe5b-4e0f-9822-15ffffaa027b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:57.108689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada995b1-fe5b-4e0f-9822-15ffffaa027b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:57.116521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:57.119594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.119890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.120878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] PATH_INFO: `/v3/users/a38b03fab5724b9da34145957c95e718` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.123003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a38b03fab5724b9da34145957c95e718)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:57.126603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:57.131353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d664a6787db46aa8342f212e2851eff', 'request_id': 'req-d3753bea-8dfa-4f5b-89b6-392545b4da77'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.140470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d664a6787db46aa8342f212e2851eff', 'request_id': 'req-d3753bea-8dfa-4f5b-89b6-392545b4da77'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.165959 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] The token cache is being invalidate because project 0d664a6787db46aa8342f212e2851eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:57.166265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.170459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.173212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1076/2116] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:56 2022] DELETE /identity/v3/projects/0d664a6787db46aa8342f212e2851eff => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:57.178210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:57.178210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:57.301273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753bea-8dfa-4f5b-89b6-392545b4da77 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:57.304121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6d062-1557-4856-80a0-e4567e2bfd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:57.305674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6d062-1557-4856-80a0-e4567e2bfd74 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.305968 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6d062-1557-4856-80a0-e4567e2bfd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.306244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6d062-1557-4856-80a0-e4567e2bfd74 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.306961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6d062-1557-4856-80a0-e4567e2bfd74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:57.308934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6d062-1557-4856-80a0-e4567e2bfd74 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:57.368941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a38b03fab5724b9da34145957c95e718'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.377832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a38b03fab5724b9da34145957c95e718'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.378686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a38b03fab5724b9da34145957c95e718'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.397193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a38b03fab5724b9da34145957c95e718'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.451832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1077/2117] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:57 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:57.453963 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425fb1-de46-4984-b81d-b4f41b6f7894 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.454511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425fb1-de46-4984-b81d-b4f41b6f7894 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.454946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425fb1-de46-4984-b81d-b4f41b6f7894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.473994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a38b03fab5724b9da34145957c95e718'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:57.485255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1041/2118] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:57 2022] DELETE /identity/v3/users/a38b03fab5724b9da34145957c95e718 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:57.487159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:57.496332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:57.519111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c7425fb1-de46-4984-b81d-b4f41b6f7894 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:57.520217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c7425fb1-de46-4984-b81d-b4f41b6f7894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:57.615524 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79a52d-8d7e-4a75-9527-b3c5d731e3c3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:57.640638 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dcada-0739-4d98-a29e-9308547687fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:57.649823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dcada-0739-4d98-a29e-9308547687fb admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.650197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1078/2119] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:57.650783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dcada-0739-4d98-a29e-9308547687fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.650783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dcada-0739-4d98-a29e-9308547687fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.651039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21065a-f5fc-4721-bfab-b5fba5e0a659 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.651039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21065a-f5fc-4721-bfab-b5fba5e0a659 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.651210 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dcada-0739-4d98-a29e-9308547687fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:57.651386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21065a-f5fc-4721-bfab-b5fba5e0a659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.651473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dcada-0739-4d98-a29e-9308547687fb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:57.672610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1042/2120] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:57.677981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3a21065a-f5fc-4721-bfab-b5fba5e0a659 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:57.679364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3a21065a-f5fc-4721-bfab-b5fba5e0a659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:57.679801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabbc22-b3a0-4777-b4dc-fccdddafd7d4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.680098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabbc22-b3a0-4777-b4dc-fccdddafd7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.682586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabbc22-b3a0-4777-b4dc-fccdddafd7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.702295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1079/2121] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:57.703491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21065a-f5fc-4721-bfab-b5fba5e0a659 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:57.717114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21065a-f5fc-4721-bfab-b5fba5e0a659 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:57.739915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d001b76-aa49-42c9-a6e8-076f9b32acdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:57.741474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-dfabbc22-b3a0-4777-b4dc-fccdddafd7d4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:57.746498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001b76-aa49-42c9-a6e8-076f9b32acdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.746498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001b76-aa49-42c9-a6e8-076f9b32acdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.746498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001b76-aa49-42c9-a6e8-076f9b32acdb admin admin] PATH_INFO: `/v3/projects/b486b27e26e94ba7adf0472d4557c592/users/e72f06115ec34fe69ab3a4e0be86a609/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.746792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dfabbc22-b3a0-4777-b4dc-fccdddafd7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:57.759021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1043/2122] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:57.759021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabbc22-b3a0-4777-b4dc-fccdddafd7d4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:57.759021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dfabbc22-b3a0-4777-b4dc-fccdddafd7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:57.761124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001b76-aa49-42c9-a6e8-076f9b32acdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b486b27e26e94ba7adf0472d4557c592, user_id=e72f06115ec34fe69ab3a4e0be86a609, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:57.764058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001b76-aa49-42c9-a6e8-076f9b32acdb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:57.824609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=2,keystone:DELETE=20,keystone:SELECT=78 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:57.848082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabbc22-b3a0-4777-b4dc-fccdddafd7d4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:57.848689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1080/2123] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:57 2022] PUT /identity/v3/projects/b486b27e26e94ba7adf0472d4557c592/users/e72f06115ec34fe69ab3a4e0be86a609/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:57.849708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d001b76-aa49-42c9-a6e8-076f9b32acdb admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:57.920556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa779271-9f5d-446a-a8de-ea6c4a738525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:57.921328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa779271-9f5d-446a-a8de-ea6c4a738525 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.921702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa779271-9f5d-446a-a8de-ea6c4a738525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.921986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa779271-9f5d-446a-a8de-ea6c4a738525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.929111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d001b76-aa49-42c9-a6e8-076f9b32acdb admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:57.933510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa779271-9f5d-446a-a8de-ea6c4a738525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:57.934562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd91ea-21bb-487b-9de2-e20dc848aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:57.935018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa779271-9f5d-446a-a8de-ea6c4a738525 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:57.935649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd91ea-21bb-487b-9de2-e20dc848aec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.936030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd91ea-21bb-487b-9de2-e20dc848aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.936443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd91ea-21bb-487b-9de2-e20dc848aec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.937534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd91ea-21bb-487b-9de2-e20dc848aec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:23:57.937938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd91ea-21bb-487b-9de2-e20dc848aec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:57.940072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd91ea-21bb-487b-9de2-e20dc848aec3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:57.946075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1044/2124] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:57.946989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa779271-9f5d-446a-a8de-ea6c4a738525 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:57.957623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa779271-9f5d-446a-a8de-ea6c4a738525 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:57.964928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb120ae-ab15-4fc8-88bf-4656c3c128f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:57.965789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb120ae-ab15-4fc8-88bf-4656c3c128f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.966143 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb120ae-ab15-4fc8-88bf-4656c3c128f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.966553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb120ae-ab15-4fc8-88bf-4656c3c128f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.967476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb120ae-ab15-4fc8-88bf-4656c3c128f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:57.969346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb120ae-ab15-4fc8-88bf-4656c3c128f6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:57.974688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1081/2125] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:23:57.976496 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd91ea-21bb-487b-9de2-e20dc848aec3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:57.984293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1045/2126] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:57.988954 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb120ae-ab15-4fc8-88bf-4656c3c128f6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:57.990123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd91ea-21bb-487b-9de2-e20dc848aec3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:57.995451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f2cd-789c-40db-9ba3-0642ade6a5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:57.996404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f2cd-789c-40db-9ba3-0642ade6a5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:57.998310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f2cd-789c-40db-9ba3-0642ade6a5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:57.998861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f2cd-789c-40db-9ba3-0642ade6a5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:57.999567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779f2cd-789c-40db-9ba3-0642ade6a5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:58.001795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779f2cd-789c-40db-9ba3-0642ade6a5c1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:58.031864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb120ae-ab15-4fc8-88bf-4656c3c128f6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:58.037892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d107c-bbc3-4f8f-b8c9-37fcab4fad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:58.038885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d107c-bbc3-4f8f-b8c9-37fcab4fad08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.039208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d107c-bbc3-4f8f-b8c9-37fcab4fad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.039494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d107c-bbc3-4f8f-b8c9-37fcab4fad08 admin admin] PATH_INFO: `/v3/projects/b486b27e26e94ba7adf0472d4557c592/users/e72f06115ec34fe69ab3a4e0be86a609/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.041724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d107c-bbc3-4f8f-b8c9-37fcab4fad08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b486b27e26e94ba7adf0472d4557c592, user_id=e72f06115ec34fe69ab3a4e0be86a609, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:58.045096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d107c-bbc3-4f8f-b8c9-37fcab4fad08 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:58.058636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1046/2127] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:57 2022] PUT /identity/v3/projects/b486b27e26e94ba7adf0472d4557c592/users/e72f06115ec34fe69ab3a4e0be86a609/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:58.069813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d07a-2508-46ee-94af-00c1c8039358 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.071164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d07a-2508-46ee-94af-00c1c8039358 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.071566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d07a-2508-46ee-94af-00c1c8039358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.109609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1082/2128] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:57 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:58.109817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d551d07a-2508-46ee-94af-00c1c8039358 None None] MFA Rules not processed for user `e72f06115ec34fe69ab3a4e0be86a609`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:58.111285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d551d07a-2508-46ee-94af-00c1c8039358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:58.113813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f2cd-789c-40db-9ba3-0642ade6a5c1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:58.211894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1047/2129] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:23:58.223904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d07a-2508-46ee-94af-00c1c8039358 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:58.227259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d551d07a-2508-46ee-94af-00c1c8039358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:58.238441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f2cd-789c-40db-9ba3-0642ade6a5c1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:58.246773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c9d9-2ca2-4af8-a75b-4c106e464403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:58.248480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c9d9-2ca2-4af8-a75b-4c106e464403 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.249342 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c9d9-2ca2-4af8-a75b-4c106e464403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.249828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c9d9-2ca2-4af8-a75b-4c106e464403 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.250714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2c9d9-2ca2-4af8-a75b-4c106e464403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:58.253561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2c9d9-2ca2-4af8-a75b-4c106e464403 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:58.312674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d07a-2508-46ee-94af-00c1c8039358 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:58.316501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dc555-a0a0-457b-9008-b667f71139ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:58.317159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dc555-a0a0-457b-9008-b667f71139ef service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.317571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dc555-a0a0-457b-9008-b667f71139ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.317868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dc555-a0a0-457b-9008-b667f71139ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.329286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dc555-a0a0-457b-9008-b667f71139ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:58.330803 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dc555-a0a0-457b-9008-b667f71139ef service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:58.351136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1048/2130] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:23:58.386907 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1083/2131] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:58 2022] POST /identity/v3/users => generated 291 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:23:58.388242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dc555-a0a0-457b-9008-b667f71139ef service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:58.408363 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dc555-a0a0-457b-9008-b667f71139ef service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:58.411078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bf48c-d401-4fcf-b4fc-917c5a580db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:58.412351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bf48c-d401-4fcf-b4fc-917c5a580db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.413264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bf48c-d401-4fcf-b4fc-917c5a580db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.413546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bf48c-d401-4fcf-b4fc-917c5a580db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.414926 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bf48c-d401-4fcf-b4fc-917c5a580db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:58.416835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bf48c-d401-4fcf-b4fc-917c5a580db4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:58.436884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1049/2132] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:58.439992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c9d9-2ca2-4af8-a75b-4c106e464403 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:58.454917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c9d9-2ca2-4af8-a75b-4c106e464403 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:58.469742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bf48c-d401-4fcf-b4fc-917c5a580db4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:58.471931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2f0bf48c-d401-4fcf-b4fc-917c5a580db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:58.472942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d00d9-ec43-4907-8860-9f4ab5e322d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:58.473792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d00d9-ec43-4907-8860-9f4ab5e322d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.474219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d00d9-ec43-4907-8860-9f4ab5e322d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.474638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d00d9-ec43-4907-8860-9f4ab5e322d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.475696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d00d9-ec43-4907-8860-9f4ab5e322d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:58.478658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d00d9-ec43-4907-8860-9f4ab5e322d2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:58.510017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bf48c-d401-4fcf-b4fc-917c5a580db4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:58.517278 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:58.518887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.519385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.523189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1084/2133] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:58.523310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] PATH_INFO: `/v3/projects/8fd5523a876549e1919db594410191f5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.523310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd5523a876549e1919db594410191f5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:58.526666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:58.526821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d00d9-ec43-4907-8860-9f4ab5e322d2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:58.558842 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d00d9-ec43-4907-8860-9f4ab5e322d2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:58.579043 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401b1b1-6dd1-4dcb-86ae-36558b00feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:58.580133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401b1b1-6dd1-4dcb-86ae-36558b00feec admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.581460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401b1b1-6dd1-4dcb-86ae-36558b00feec admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.581460 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401b1b1-6dd1-4dcb-86ae-36558b00feec admin admin] PATH_INFO: `/v3/projects/9b45c47bc02b4dfe804ae51c6820277f/users/8af2a129f17e4a018cf2166adda7ecaf/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.605928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401b1b1-6dd1-4dcb-86ae-36558b00feec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b45c47bc02b4dfe804ae51c6820277f, user_id=8af2a129f17e4a018cf2166adda7ecaf, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:58.609174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401b1b1-6dd1-4dcb-86ae-36558b00feec admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:58.691656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:23:58.724148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1085/2134] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:58 2022] PUT /identity/v3/projects/9b45c47bc02b4dfe804ae51c6820277f/users/8af2a129f17e4a018cf2166adda7ecaf/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:58.725669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d13426-700b-4575-abee-c1c6627b1f98 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.728415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d13426-700b-4575-abee-c1c6627b1f98 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.729694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d13426-700b-4575-abee-c1c6627b1f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.747680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd5523a876549e1919db594410191f5', 'request_id': 'req-aae54254-7ead-442f-b249-7e3b603f62a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:58.772467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-59d13426-700b-4575-abee-c1c6627b1f98 None None] MFA Rules not processed for user `dddeab201f17411998952f405f0ee47d`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:58.774671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-59d13426-700b-4575-abee-c1c6627b1f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:58.844968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd5523a876549e1919db594410191f5', 'request_id': 'req-aae54254-7ead-442f-b249-7e3b603f62a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:58.857392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd5523a876549e1919db594410191f5', 'request_id': 'req-aae54254-7ead-442f-b249-7e3b603f62a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:58.892656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] The token cache is being invalidate because project 8fd5523a876549e1919db594410191f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:23:58.892965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:58.893807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:58.900192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1050/2135] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:23:58 2022] DELETE /identity/v3/projects/8fd5523a876549e1919db594410191f5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:23:58.901163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:58.904980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:58.905772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1086/2136] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:58.907931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a34e-19da-4f22-b9eb-377f26ae2f91 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:58.908749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a34e-19da-4f22-b9eb-377f26ae2f91 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:58.908749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a34e-19da-4f22-b9eb-377f26ae2f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:58.978274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9e72a34e-19da-4f22-b9eb-377f26ae2f91 None None] MFA Rules not processed for user `8af2a129f17e4a018cf2166adda7ecaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:58.979960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9e72a34e-19da-4f22-b9eb-377f26ae2f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:59.063018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae54254-7ead-442f-b249-7e3b603f62a2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:59.063018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91468127-7d25-4ec1-b682-995e2b7858c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:59.063018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468127-7d25-4ec1-b682-995e2b7858c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:59.063452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468127-7d25-4ec1-b682-995e2b7858c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:59.063597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468127-7d25-4ec1-b682-995e2b7858c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:59.065680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-91468127-7d25-4ec1-b682-995e2b7858c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:59.096135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1087/2137] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:59.096135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a34e-19da-4f22-b9eb-377f26ae2f91 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:59.096135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9e72a34e-19da-4f22-b9eb-377f26ae2f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:59.144038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91468127-7d25-4ec1-b682-995e2b7858c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:59.146172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91468127-7d25-4ec1-b682-995e2b7858c7 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:59.169355 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1051/2138] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:59.171797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89aa5a-b1a1-4b50-ad9c-95b95f231658 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:59.172091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89aa5a-b1a1-4b50-ad9c-95b95f231658 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:59.172399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89aa5a-b1a1-4b50-ad9c-95b95f231658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:59.199314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a34e-19da-4f22-b9eb-377f26ae2f91 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:59.206449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:59.208642 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:59.209173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:59.209730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] PATH_INFO: `/v3/users/b003ea1970114ae38530b9a5a1fa077b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:59.212270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b003ea1970114ae38530b9a5a1fa077b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:59.214614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-de89aa5a-b1a1-4b50-ad9c-95b95f231658 None None] MFA Rules not processed for user `2b2feeae716a4f0899a6a914cb603bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:23:59.215231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:59.220746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-de89aa5a-b1a1-4b50-ad9c-95b95f231658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:59.306729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1052/2139] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:23:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:23:59.307831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89aa5a-b1a1-4b50-ad9c-95b95f231658 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:59.309255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-de89aa5a-b1a1-4b50-ad9c-95b95f231658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:59.335020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89aa5a-b1a1-4b50-ad9c-95b95f231658 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:59.335020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae795a-184e-4a7f-9ee7-4b675313b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:59.335707 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae795a-184e-4a7f-9ee7-4b675313b193 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:59.336669 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae795a-184e-4a7f-9ee7-4b675313b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:59.336959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae795a-184e-4a7f-9ee7-4b675313b193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:59.338927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae795a-184e-4a7f-9ee7-4b675313b193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:59.342112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae795a-184e-4a7f-9ee7-4b675313b193 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:59.451510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1053/2140] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:23:59 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:59.452908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae795a-184e-4a7f-9ee7-4b675313b193 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:59.454989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2bae795a-184e-4a7f-9ee7-4b675313b193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:59.462965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b003ea1970114ae38530b9a5a1fa077b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:59.464345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b003ea1970114ae38530b9a5a1fa077b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:59.473722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b003ea1970114ae38530b9a5a1fa077b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:59.474581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b003ea1970114ae38530b9a5a1fa077b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:59.492279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b003ea1970114ae38530b9a5a1fa077b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:23:59.532969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae795a-184e-4a7f-9ee7-4b675313b193 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:59.539061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7c591-dd3a-4da3-8a25-e4ff35adafae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:59.539729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c591-dd3a-4da3-8a25-e4ff35adafae service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:59.540010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c591-dd3a-4da3-8a25-e4ff35adafae service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:59.540425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c591-dd3a-4da3-8a25-e4ff35adafae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:59.542155 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-48a7c591-dd3a-4da3-8a25-e4ff35adafae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:59.580346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1088/2141] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:23:59 2022] DELETE /identity/v3/users/b003ea1970114ae38530b9a5a1fa077b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:23:59.583767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:59.583767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:23:59.646444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7c591-dd3a-4da3-8a25-e4ff35adafae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:59.648052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7c591-dd3a-4da3-8a25-e4ff35adafae service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:59.659999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1054/2142] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:23:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:23:59.724806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5bdf2-642c-4163-9214-7fd1711725ad admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:59.732284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56c592-9910-45fc-9b1a-0350d017dd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:59.733083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c592-9910-45fc-9b1a-0350d017dd7a admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:59.733372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c592-9910-45fc-9b1a-0350d017dd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:59.743769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c592-9910-45fc-9b1a-0350d017dd7a admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:59.743769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56c592-9910-45fc-9b1a-0350d017dd7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:59.743769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56c592-9910-45fc-9b1a-0350d017dd7a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:59.837071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1089/2143] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:23:59 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:23:59.838429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7c591-dd3a-4da3-8a25-e4ff35adafae service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:23:59.945302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7c591-dd3a-4da3-8a25-e4ff35adafae service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:23:59.958518 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f2d6b-9c02-4dfc-b7f4-79f282fd5bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:23:59.961113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f2d6b-9c02-4dfc-b7f4-79f282fd5bac admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:23:59.961579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f2d6b-9c02-4dfc-b7f4-79f282fd5bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:23:59.962211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f2d6b-9c02-4dfc-b7f4-79f282fd5bac admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:23:59.963608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f2d6b-9c02-4dfc-b7f4-79f282fd5bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:23:59.965588 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f2d6b-9c02-4dfc-b7f4-79f282fd5bac admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:23:59.981914 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1055/2144] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:23:59.982758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56c592-9910-45fc-9b1a-0350d017dd7a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:00.005265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56c592-9910-45fc-9b1a-0350d017dd7a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:00.011641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f1e03-93b2-4a7d-a0cf-2bb631a0e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:00.012110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f1e03-93b2-4a7d-a0cf-2bb631a0e080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:00.012781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f1e03-93b2-4a7d-a0cf-2bb631a0e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:00.013774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f1e03-93b2-4a7d-a0cf-2bb631a0e080 admin admin] PATH_INFO: `/v3/projects/3973b881d9ad46cf9307df3caeacdfb7/users/8a52d0d0445c4daa93816954a7001d69/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:00.034350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f1e03-93b2-4a7d-a0cf-2bb631a0e080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3973b881d9ad46cf9307df3caeacdfb7, user_id=8a52d0d0445c4daa93816954a7001d69, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:00.037017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f1e03-93b2-4a7d-a0cf-2bb631a0e080 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:00.160628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:00.168078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1090/2145] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:23:59 2022] PUT /identity/v3/projects/3973b881d9ad46cf9307df3caeacdfb7/users/8a52d0d0445c4daa93816954a7001d69/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:00.172104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f2d6b-9c02-4dfc-b7f4-79f282fd5bac admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:00.184871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f2d6b-9c02-4dfc-b7f4-79f282fd5bac admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:00.294957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f29a26-cfaa-4710-9124-fcbe9c897925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:00.298840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f29a26-cfaa-4710-9124-fcbe9c897925 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:00.298840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f29a26-cfaa-4710-9124-fcbe9c897925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:00.298840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f29a26-cfaa-4710-9124-fcbe9c897925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:00.298840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f29a26-cfaa-4710-9124-fcbe9c897925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:00.299190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f29a26-cfaa-4710-9124-fcbe9c897925 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:00.311585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1056/2146] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:00.317608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f1e03-93b2-4a7d-a0cf-2bb631a0e080 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:00.330495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f1e03-93b2-4a7d-a0cf-2bb631a0e080 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:00.334346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0b176-bc0e-464e-b467-a18e3e012cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:00.335231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0b176-bc0e-464e-b467-a18e3e012cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:00.335510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0b176-bc0e-464e-b467-a18e3e012cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:00.335786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0b176-bc0e-464e-b467-a18e3e012cc0 admin admin] PATH_INFO: `/v3/projects/3973b881d9ad46cf9307df3caeacdfb7/users/8a52d0d0445c4daa93816954a7001d69/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:00.337790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0b176-bc0e-464e-b467-a18e3e012cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3973b881d9ad46cf9307df3caeacdfb7, user_id=8a52d0d0445c4daa93816954a7001d69, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:00.340483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0b176-bc0e-464e-b467-a18e3e012cc0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:00.357145 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f29a26-cfaa-4710-9124-fcbe9c897925 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:00.359581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-68f29a26-cfaa-4710-9124-fcbe9c897925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:00.379977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1091/2147] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:24:00 2022] PUT /identity/v3/projects/3973b881d9ad46cf9307df3caeacdfb7/users/8a52d0d0445c4daa93816954a7001d69/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:00.381342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f29a26-cfaa-4710-9124-fcbe9c897925 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:00.399279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a044a4-aaad-48bb-8047-21be204521db None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:00.399469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a044a4-aaad-48bb-8047-21be204521db None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:00.399752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a044a4-aaad-48bb-8047-21be204521db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:00.439648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-34a044a4-aaad-48bb-8047-21be204521db None None] MFA Rules not processed for user `8a52d0d0445c4daa93816954a7001d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:00.441456 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-34a044a4-aaad-48bb-8047-21be204521db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:00.464938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:00.467115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:00.467496 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:00.467782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] PATH_INFO: `/v3/projects/1cf26c04bfe54eedb22a70017188674b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:00.470410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf26c04bfe54eedb22a70017188674b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:00.472770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:00.547773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1092/2148] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:00.559534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a044a4-aaad-48bb-8047-21be204521db None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:00.561233 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-34a044a4-aaad-48bb-8047-21be204521db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:00.617695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf26c04bfe54eedb22a70017188674b', 'request_id': 'req-a841a402-a0ed-44df-8fdb-7be76780f243'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:00.699157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a044a4-aaad-48bb-8047-21be204521db None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:00.704012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf26c04bfe54eedb22a70017188674b', 'request_id': 'req-a841a402-a0ed-44df-8fdb-7be76780f243'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:00.716620 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf26c04bfe54eedb22a70017188674b', 'request_id': 'req-a841a402-a0ed-44df-8fdb-7be76780f243'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:00.741211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] The token cache is being invalidate because project 1cf26c04bfe54eedb22a70017188674b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:00.745848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:00.745848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a841a402-a0ed-44df-8fdb-7be76780f243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:00.749532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1057/2149] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:00 2022] DELETE /identity/v3/projects/1cf26c04bfe54eedb22a70017188674b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:24:00.756603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993968cf-1df3-4d31-82eb-116841595e57 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:00.757386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993968cf-1df3-4d31-82eb-116841595e57 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:00.757646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993968cf-1df3-4d31-82eb-116841595e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:00.833864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-993968cf-1df3-4d31-82eb-116841595e57 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:00.835140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-993968cf-1df3-4d31-82eb-116841595e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:00.836926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a188a-969a-4574-84b6-59c14075562d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:00.837648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a188a-969a-4574-84b6-59c14075562d service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:00.837935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a188a-969a-4574-84b6-59c14075562d service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:00.838215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a188a-969a-4574-84b6-59c14075562d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:00.841166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b22a188a-969a-4574-84b6-59c14075562d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:00.987300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1058/2150] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:00.987764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a188a-969a-4574-84b6-59c14075562d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:00.990379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a188a-969a-4574-84b6-59c14075562d service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:00.995905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c037-5e08-4b1b-8ce1-f802249c9bfc None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:00.997747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c037-5e08-4b1b-8ce1-f802249c9bfc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:00.998494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c037-5e08-4b1b-8ce1-f802249c9bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:01.034079 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1093/2151] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:01.045752 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5f33c037-5e08-4b1b-8ce1-f802249c9bfc None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:01.047423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f33c037-5e08-4b1b-8ce1-f802249c9bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:01.074614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a188a-969a-4574-84b6-59c14075562d service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:01.080400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1059/2152] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:01.099299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a188a-969a-4574-84b6-59c14075562d service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:01.117524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:01.118372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:01.120116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:01.120116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:01.120116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:24:01.120575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:01.122345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:01.136383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1094/2153] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:24:01.146004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c037-5e08-4b1b-8ce1-f802249c9bfc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:01.157501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c037-5e08-4b1b-8ce1-f802249c9bfc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:01.167686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9b68-c9ef-44c9-9776-3db41974e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:01.169737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9b68-c9ef-44c9-9776-3db41974e8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:01.169737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9b68-c9ef-44c9-9776-3db41974e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:01.169737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9b68-c9ef-44c9-9776-3db41974e8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:01.170754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec9b68-c9ef-44c9-9776-3db41974e8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:01.172936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec9b68-c9ef-44c9-9776-3db41974e8f2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:01.250064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:01.252037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:01.281665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622960-3a8c-4c4b-a58a-2a906de04e94 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:01.286360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:01.286646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1060/2154] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:24:01 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:01.292429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671bfc0-405d-4ca9-97dd-0f38d5fbe344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:01.294813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671bfc0-405d-4ca9-97dd-0f38d5fbe344 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:01.295644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671bfc0-405d-4ca9-97dd-0f38d5fbe344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:01.296093 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671bfc0-405d-4ca9-97dd-0f38d5fbe344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:01.297581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9b68-c9ef-44c9-9776-3db41974e8f2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:01.298732 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9671bfc0-405d-4ca9-97dd-0f38d5fbe344 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:01.407377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671bfc0-405d-4ca9-97dd-0f38d5fbe344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:01.409634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671bfc0-405d-4ca9-97dd-0f38d5fbe344 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:01.424354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1095/2155] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:24:01.457696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9b68-c9ef-44c9-9776-3db41974e8f2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:01.464032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd06566-8203-469f-bbbc-f18b77217b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:01.464907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd06566-8203-469f-bbbc-f18b77217b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:01.466067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd06566-8203-469f-bbbc-f18b77217b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:01.466067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd06566-8203-469f-bbbc-f18b77217b9a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:01.466378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd06566-8203-469f-bbbc-f18b77217b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:01.468570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd06566-8203-469f-bbbc-f18b77217b9a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:01.586360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1061/2156] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:24:01 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:01.590501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671bfc0-405d-4ca9-97dd-0f38d5fbe344 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:01.603622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671bfc0-405d-4ca9-97dd-0f38d5fbe344 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:01.611264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a66f2-e6dc-4094-8679-3257308d4ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:01.611958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a66f2-e6dc-4094-8679-3257308d4ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:01.612281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a66f2-e6dc-4094-8679-3257308d4ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:01.612621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a66f2-e6dc-4094-8679-3257308d4ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:01.613383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a66f2-e6dc-4094-8679-3257308d4ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:01.615518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a66f2-e6dc-4094-8679-3257308d4ba8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:01.631379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1096/2157] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:01.639591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd06566-8203-469f-bbbc-f18b77217b9a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:01.644220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd06566-8203-469f-bbbc-f18b77217b9a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:01.651181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b342cdc-1d52-47a7-af1e-1b7efc306d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:01.652760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b342cdc-1d52-47a7-af1e-1b7efc306d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:01.653048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b342cdc-1d52-47a7-af1e-1b7efc306d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:01.653405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b342cdc-1d52-47a7-af1e-1b7efc306d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:01.654152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b342cdc-1d52-47a7-af1e-1b7efc306d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:01.657345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b342cdc-1d52-47a7-af1e-1b7efc306d42 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:01.673510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1062/2158] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:01.674640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a66f2-e6dc-4094-8679-3257308d4ba8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:01.689840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a66f2-e6dc-4094-8679-3257308d4ba8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:01.696540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b6e07-9ea3-47e4-9dcb-d8b94ddd8aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:01.698243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6e07-9ea3-47e4-9dcb-d8b94ddd8aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:01.698243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6e07-9ea3-47e4-9dcb-d8b94ddd8aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:01.698605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6e07-9ea3-47e4-9dcb-d8b94ddd8aa5 admin admin] PATH_INFO: `/v3/projects/e945118c79424c2a8dff352d5fb102d2/users/b7dca72f701840d88253b6ca90b886e5/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:01.721781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b6e07-9ea3-47e4-9dcb-d8b94ddd8aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e945118c79424c2a8dff352d5fb102d2, user_id=b7dca72f701840d88253b6ca90b886e5, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:01.725457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b6e07-9ea3-47e4-9dcb-d8b94ddd8aa5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:01.828900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1097/2159] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:24:01 2022] PUT /identity/v3/projects/e945118c79424c2a8dff352d5fb102d2/users/b7dca72f701840d88253b6ca90b886e5/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:01.839981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8efb4-b349-425c-9238-9d943ae31730 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:01.840299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8efb4-b349-425c-9238-9d943ae31730 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:01.840621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8efb4-b349-425c-9238-9d943ae31730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:01.870422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3be8efb4-b349-425c-9238-9d943ae31730 None None] MFA Rules not processed for user `b7dca72f701840d88253b6ca90b886e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:01.871952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3be8efb4-b349-425c-9238-9d943ae31730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:01.948225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1063/2160] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:01.960773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b6e07-9ea3-47e4-9dcb-d8b94ddd8aa5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:01.963365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-116b6e07-9ea3-47e4-9dcb-d8b94ddd8aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:02.037722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b6e07-9ea3-47e4-9dcb-d8b94ddd8aa5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:02.044741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a5dd8-24aa-4a0c-a55f-70d04ef6f316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:02.048098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a5dd8-24aa-4a0c-a55f-70d04ef6f316 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:02.048098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a5dd8-24aa-4a0c-a55f-70d04ef6f316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:02.048098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a5dd8-24aa-4a0c-a55f-70d04ef6f316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:02.060484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a5dd8-24aa-4a0c-a55f-70d04ef6f316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:02.062640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a5dd8-24aa-4a0c-a55f-70d04ef6f316 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:02.069800 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8efb4-b349-425c-9238-9d943ae31730 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:02.071747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3be8efb4-b349-425c-9238-9d943ae31730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:02.087302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1098/2161] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:02.167419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8efb4-b349-425c-9238-9d943ae31730 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:02.176261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:02.177557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:02.177946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:02.178420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] PATH_INFO: `/v3/users/8af2a129f17e4a018cf2166adda7ecaf` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:02.188836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af2a129f17e4a018cf2166adda7ecaf)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:02.190943 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:02.413968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af2a129f17e4a018cf2166adda7ecaf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:02.448997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af2a129f17e4a018cf2166adda7ecaf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:02.448997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af2a129f17e4a018cf2166adda7ecaf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:02.477479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af2a129f17e4a018cf2166adda7ecaf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:02.554170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af2a129f17e4a018cf2166adda7ecaf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:02.564190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1064/2162] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:02 2022] DELETE /identity/v3/users/8af2a129f17e4a018cf2166adda7ecaf => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:02.568512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d5812-abf6-44cc-9179-ced33c8d5f64 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:02.568721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d5812-abf6-44cc-9179-ced33c8d5f64 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:02.569013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d5812-abf6-44cc-9179-ced33c8d5f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:02.582821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:DELETE=12 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:02.652771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-788d5812-abf6-44cc-9179-ced33c8d5f64 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:02.654312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-788d5812-abf6-44cc-9179-ced33c8d5f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:02.726070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1099/2163] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:02.736704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:02.738121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:02.839928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107f243-7707-416d-a88a-b9f9ecb36288 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:02.846445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977c6d-5934-43ea-b3cc-443e1ebf98ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:02.848022 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977c6d-5934-43ea-b3cc-443e1ebf98ab service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:02.848465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977c6d-5934-43ea-b3cc-443e1ebf98ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:02.848833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977c6d-5934-43ea-b3cc-443e1ebf98ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:02.863229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d977c6d-5934-43ea-b3cc-443e1ebf98ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:02.866699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d977c6d-5934-43ea-b3cc-443e1ebf98ab service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:02.907455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1065/2164] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:03.106231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7cc9e-49c7-42c0-b923-75466b6e90eb None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:03.106740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7cc9e-49c7-42c0-b923-75466b6e90eb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:03.106821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7cc9e-49c7-42c0-b923-75466b6e90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:03.142864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-31e7cc9e-49c7-42c0-b923-75466b6e90eb None None] MFA Rules not processed for user `53490cc482c149eaa28f80b868dba094`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:03.144717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-31e7cc9e-49c7-42c0-b923-75466b6e90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:03.276340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1100/2165] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:03.282255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977c6d-5934-43ea-b3cc-443e1ebf98ab service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:03.283794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5d977c6d-5934-43ea-b3cc-443e1ebf98ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:03.389593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977c6d-5934-43ea-b3cc-443e1ebf98ab service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:03.395229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3d28f-4ccc-4d47-ae0f-6a56ff1449e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:03.397471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3d28f-4ccc-4d47-ae0f-6a56ff1449e9 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:03.397471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3d28f-4ccc-4d47-ae0f-6a56ff1449e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:03.397471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3d28f-4ccc-4d47-ae0f-6a56ff1449e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:03.408159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3d28f-4ccc-4d47-ae0f-6a56ff1449e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:03.409995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3d28f-4ccc-4d47-ae0f-6a56ff1449e9 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:03.422683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1066/2166] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:03.436937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7cc9e-49c7-42c0-b923-75466b6e90eb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:03.438615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-31e7cc9e-49c7-42c0-b923-75466b6e90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:03.477587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7cc9e-49c7-42c0-b923-75466b6e90eb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:03.484067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:03.485324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:03.485707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:03.486141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] PATH_INFO: `/v3/projects/9b45c47bc02b4dfe804ae51c6820277f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:03.487580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b45c47bc02b4dfe804ae51c6820277f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:03.490049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:03.657825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b45c47bc02b4dfe804ae51c6820277f', 'request_id': 'req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:03.768869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b45c47bc02b4dfe804ae51c6820277f', 'request_id': 'req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:03.794074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b45c47bc02b4dfe804ae51c6820277f', 'request_id': 'req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:03.821644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] The token cache is being invalidate because project 9b45c47bc02b4dfe804ae51c6820277f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:03.821936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:03.822625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:03.824584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1101/2167] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:03 2022] DELETE /identity/v3/projects/9b45c47bc02b4dfe804ae51c6820277f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:03.828353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3d28f-4ccc-4d47-ae0f-6a56ff1449e9 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:03.841050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3d28f-4ccc-4d47-ae0f-6a56ff1449e9 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:03.962439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:03.974230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:03.974529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:03.976190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] PATH_INFO: `/v3/users/8a52d0d0445c4daa93816954a7001d69` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:03.978015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a52d0d0445c4daa93816954a7001d69)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:03.984175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:04.042470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:04.335788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a52d0d0445c4daa93816954a7001d69'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:04.363010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a52d0d0445c4daa93816954a7001d69'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:04.371688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a52d0d0445c4daa93816954a7001d69'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:04.442317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a52d0d0445c4daa93816954a7001d69'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:04.554481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ec6e02de-3e16-4a63-b66d-f7face57c868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a52d0d0445c4daa93816954a7001d69'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:04.564948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1067/2168] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:03 2022] DELETE /identity/v3/users/8a52d0d0445c4daa93816954a7001d69 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:05.869952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:05.934568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:05.939448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:05.965935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd817f-a4a5-4f3c-a7c8-a5aaa53f968a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:06.059111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:06.060394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:06.061549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:06.061750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] PATH_INFO: `/v3/projects/3973b881d9ad46cf9307df3caeacdfb7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:06.063259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3973b881d9ad46cf9307df3caeacdfb7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:06.066457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:06.233285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3973b881d9ad46cf9307df3caeacdfb7', 'request_id': 'req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:06.349143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3973b881d9ad46cf9307df3caeacdfb7', 'request_id': 'req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:06.358958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3973b881d9ad46cf9307df3caeacdfb7', 'request_id': 'req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:06.384486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] The token cache is being invalidate because project 3973b881d9ad46cf9307df3caeacdfb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:06.384801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:06.385610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2db439de-eb4e-4231-aaa7-c4e1b2f51cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:06.388150 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1102/2169] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:05 2022] DELETE /identity/v3/projects/3973b881d9ad46cf9307df3caeacdfb7 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:06.393160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f376-cd75-495e-b527-881abbf9652d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:06.393452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f376-cd75-495e-b527-881abbf9652d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:06.393737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f376-cd75-495e-b527-881abbf9652d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:06.443915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6877f376-cd75-495e-b527-881abbf9652d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:06.444107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6877f376-cd75-495e-b527-881abbf9652d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:06.545547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1068/2170] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:06.553016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df0677-b341-4757-8211-8a34244d9dc1 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:06.553307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df0677-b341-4757-8211-8a34244d9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:06.553588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df0677-b341-4757-8211-8a34244d9dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:06.587218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-58df0677-b341-4757-8211-8a34244d9dc1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:06.588509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-58df0677-b341-4757-8211-8a34244d9dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:06.610072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1103/2171] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:06.614046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877f376-cd75-495e-b527-881abbf9652d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:06.632804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877f376-cd75-495e-b527-881abbf9652d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:06.639199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53600d1-2c17-4ebb-9f16-15869150ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:06.639901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53600d1-2c17-4ebb-9f16-15869150ec73 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:06.640291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53600d1-2c17-4ebb-9f16-15869150ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:06.640809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53600d1-2c17-4ebb-9f16-15869150ec73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:06.641856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53600d1-2c17-4ebb-9f16-15869150ec73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:24:06.642047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53600d1-2c17-4ebb-9f16-15869150ec73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:06.643788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53600d1-2c17-4ebb-9f16-15869150ec73 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:06.671375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1069/2172] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:24:06.673262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df0677-b341-4757-8211-8a34244d9dc1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:06.684408 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df0677-b341-4757-8211-8a34244d9dc1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:06.698128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeef3c-f77e-43c1-b404-f63e5e859d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:06.699260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeef3c-f77e-43c1-b404-f63e5e859d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:06.700029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeef3c-f77e-43c1-b404-f63e5e859d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:06.700562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeef3c-f77e-43c1-b404-f63e5e859d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:06.705338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeef3c-f77e-43c1-b404-f63e5e859d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:06.709823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeef3c-f77e-43c1-b404-f63e5e859d23 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:06.850650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1104/2173] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:24:06 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:06.854968 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53600d1-2c17-4ebb-9f16-15869150ec73 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:06.869584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53600d1-2c17-4ebb-9f16-15869150ec73 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:06.967406 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb62dd-a6a5-48b7-9ec2-c4ac767798ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:06.968245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb62dd-a6a5-48b7-9ec2-c4ac767798ea admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:06.968670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb62dd-a6a5-48b7-9ec2-c4ac767798ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:06.969048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb62dd-a6a5-48b7-9ec2-c4ac767798ea admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:06.969848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb62dd-a6a5-48b7-9ec2-c4ac767798ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:06.977281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb62dd-a6a5-48b7-9ec2-c4ac767798ea admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:07.064519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1070/2174] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:24:06 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:07.068240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeef3c-f77e-43c1-b404-f63e5e859d23 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:07.078582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeef3c-f77e-43c1-b404-f63e5e859d23 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:07.081555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:07.085840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74fe19-ff29-4bcb-9716-d7780edf7e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:07.087326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74fe19-ff29-4bcb-9716-d7780edf7e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.087618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74fe19-ff29-4bcb-9716-d7780edf7e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.090331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74fe19-ff29-4bcb-9716-d7780edf7e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.090331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74fe19-ff29-4bcb-9716-d7780edf7e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:07.090331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74fe19-ff29-4bcb-9716-d7780edf7e47 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:07.100267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb62dd-a6a5-48b7-9ec2-c4ac767798ea admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:07.103081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-82cb62dd-a6a5-48b7-9ec2-c4ac767798ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:07.107475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1105/2175] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:07.108763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74fe19-ff29-4bcb-9716-d7780edf7e47 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:07.121645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74fe19-ff29-4bcb-9716-d7780edf7e47 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:07.126311 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4e4e-ca76-474f-8fcb-2e021ddfba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:07.127009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4e4e-ca76-474f-8fcb-2e021ddfba22 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.127353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4e4e-ca76-474f-8fcb-2e021ddfba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.127692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4e4e-ca76-474f-8fcb-2e021ddfba22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.128452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d4e4e-ca76-474f-8fcb-2e021ddfba22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:07.130166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d4e4e-ca76-474f-8fcb-2e021ddfba22 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:07.133529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb62dd-a6a5-48b7-9ec2-c4ac767798ea admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:07.139933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:07.141087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.141428 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.141764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] PATH_INFO: `/v3/users/3715f6452c0548a691a1596f6390dc65` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.142121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1106/2176] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:24:07.146009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3715f6452c0548a691a1596f6390dc65)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:07.146141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4e4e-ca76-474f-8fcb-2e021ddfba22 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:07.148083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:07.157175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4e4e-ca76-474f-8fcb-2e021ddfba22 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:07.165621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b0b5a-e6c2-46a0-8f55-c492a072e449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:07.166530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b0b5a-e6c2-46a0-8f55-c492a072e449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.170584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b0b5a-e6c2-46a0-8f55-c492a072e449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.170584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b0b5a-e6c2-46a0-8f55-c492a072e449 admin admin] PATH_INFO: `/v3/projects/6f163c700bdb4419a3042ab4a474dc8d/users/7f9a3cd5dcfb47fb9a56c7bcbf6f4299/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.185145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b0b5a-e6c2-46a0-8f55-c492a072e449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f163c700bdb4419a3042ab4a474dc8d, user_id=7f9a3cd5dcfb47fb9a56c7bcbf6f4299, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:07.188197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b0b5a-e6c2-46a0-8f55-c492a072e449 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:07.267471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1107/2177] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:24:07 2022] PUT /identity/v3/projects/6f163c700bdb4419a3042ab4a474dc8d/users/7f9a3cd5dcfb47fb9a56c7bcbf6f4299/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:07.279287 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec68c4-6cf0-4f8e-8664-26cb81633b0c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.279577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec68c4-6cf0-4f8e-8664-26cb81633b0c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.279855 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec68c4-6cf0-4f8e-8664-26cb81633b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.305790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-63ec68c4-6cf0-4f8e-8664-26cb81633b0c None None] MFA Rules not processed for user `7f9a3cd5dcfb47fb9a56c7bcbf6f4299`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:07.306992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-63ec68c4-6cf0-4f8e-8664-26cb81633b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:07.356498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3715f6452c0548a691a1596f6390dc65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.367247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3715f6452c0548a691a1596f6390dc65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.368192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3715f6452c0548a691a1596f6390dc65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.386881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3715f6452c0548a691a1596f6390dc65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.387611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1108/2178] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:24:07.401065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec68c4-6cf0-4f8e-8664-26cb81633b0c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:07.402668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-63ec68c4-6cf0-4f8e-8664-26cb81633b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:07.461599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec68c4-6cf0-4f8e-8664-26cb81633b0c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:07.467228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a55fb-9102-4abb-b420-f206342801b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:07.467967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a55fb-9102-4abb-b420-f206342801b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.468351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a55fb-9102-4abb-b420-f206342801b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.468795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a55fb-9102-4abb-b420-f206342801b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.474738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a60dc432-aec5-4e52-aac8-da843d6826ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3715f6452c0548a691a1596f6390dc65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.480181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a55fb-9102-4abb-b420-f206342801b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:07.482427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a55fb-9102-4abb-b420-f206342801b2 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:07.484634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1071/2179] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:07 2022] DELETE /identity/v3/users/3715f6452c0548a691a1596f6390dc65 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:07.489359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed104c-b632-460f-a596-2a1ba651ee97 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.489879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed104c-b632-460f-a596-2a1ba651ee97 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.490513 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed104c-b632-460f-a596-2a1ba651ee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.496752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1109/2180] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:24:07.510546 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-76ed104c-b632-460f-a596-2a1ba651ee97 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:07.511894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-76ed104c-b632-460f-a596-2a1ba651ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:07.520055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a55fb-9102-4abb-b420-f206342801b2 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:07.576798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1072/2181] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:07.587569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed104c-b632-460f-a596-2a1ba651ee97 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:07.589112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-76ed104c-b632-460f-a596-2a1ba651ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:07.601520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a55fb-9102-4abb-b420-f206342801b2 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:07.606808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:07.608700 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.608700 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.608700 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] PATH_INFO: `/v3/users/7f9a3cd5dcfb47fb9a56c7bcbf6f4299` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.609572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9a3cd5dcfb47fb9a56c7bcbf6f4299)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:07.611865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:07.648433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed104c-b632-460f-a596-2a1ba651ee97 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:07.652707 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497136d-69ac-4faf-83c3-cf1a70c691ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:07.653437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497136d-69ac-4faf-83c3-cf1a70c691ff service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.653649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497136d-69ac-4faf-83c3-cf1a70c691ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.653923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497136d-69ac-4faf-83c3-cf1a70c691ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.663957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497136d-69ac-4faf-83c3-cf1a70c691ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:07.665471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497136d-69ac-4faf-83c3-cf1a70c691ff service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:07.675163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1073/2182] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:24:07.858534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9a3cd5dcfb47fb9a56c7bcbf6f4299'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.859101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9a3cd5dcfb47fb9a56c7bcbf6f4299'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.867015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9a3cd5dcfb47fb9a56c7bcbf6f4299'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.867777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9a3cd5dcfb47fb9a56c7bcbf6f4299'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.887778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-33f5b553-f69f-4133-b5a0-65fa85b71b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9a3cd5dcfb47fb9a56c7bcbf6f4299'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:07.954458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1110/2183] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:07 2022] DELETE /identity/v3/users/7f9a3cd5dcfb47fb9a56c7bcbf6f4299 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:07.958974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74204527-8239-4553-b2fc-0aa14c692aa4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.959359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74204527-8239-4553-b2fc-0aa14c692aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.959633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74204527-8239-4553-b2fc-0aa14c692aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:07.982409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-74204527-8239-4553-b2fc-0aa14c692aa4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:07.983816 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-74204527-8239-4553-b2fc-0aa14c692aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:07.984659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269eb6d-a30a-4d6d-a5af-502be575a812 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:07.985020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269eb6d-a30a-4d6d-a5af-502be575a812 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:07.985392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269eb6d-a30a-4d6d-a5af-502be575a812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:08.005600 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3269eb6d-a30a-4d6d-a5af-502be575a812 None None] MFA Rules not processed for user `53490cc482c149eaa28f80b868dba094`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:08.006953 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3269eb6d-a30a-4d6d-a5af-502be575a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:08.046868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1074/2184] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:08.057200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74204527-8239-4553-b2fc-0aa14c692aa4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:08.058595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-74204527-8239-4553-b2fc-0aa14c692aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:08.068829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1111/2185] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:24:08.093242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269eb6d-a30a-4d6d-a5af-502be575a812 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:08.095271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3269eb6d-a30a-4d6d-a5af-502be575a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:08.113024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269eb6d-a30a-4d6d-a5af-502be575a812 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:08.122214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:08.123281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:08.123795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:08.124537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] PATH_INFO: `/v3/projects/8ee74e60d08b4c2192ce78726aeba128` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:08.139722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee74e60d08b4c2192ce78726aeba128)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:08.141575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:08.144756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74204527-8239-4553-b2fc-0aa14c692aa4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:08.149856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f552e9c-ae55-4028-ab76-82316687d188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:08.150682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f552e9c-ae55-4028-ab76-82316687d188 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:08.150965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f552e9c-ae55-4028-ab76-82316687d188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:08.151242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f552e9c-ae55-4028-ab76-82316687d188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:08.164743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f552e9c-ae55-4028-ab76-82316687d188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:08.166921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f552e9c-ae55-4028-ab76-82316687d188 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:08.178602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1075/2186] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:24:08.292584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee74e60d08b4c2192ce78726aeba128', 'request_id': 'req-299586f6-0c2e-4703-aaf0-af0f7c64be7b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.388435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee74e60d08b4c2192ce78726aeba128', 'request_id': 'req-299586f6-0c2e-4703-aaf0-af0f7c64be7b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.397029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee74e60d08b4c2192ce78726aeba128', 'request_id': 'req-299586f6-0c2e-4703-aaf0-af0f7c64be7b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.410530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] The token cache is being invalidate because project 8ee74e60d08b4c2192ce78726aeba128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:08.411175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.411944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:08.412838 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.415549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1112/2187] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:08 2022] DELETE /identity/v3/projects/8ee74e60d08b4c2192ce78726aeba128 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:24:08.419683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f552e9c-ae55-4028-ab76-82316687d188 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:08.429739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f552e9c-ae55-4028-ab76-82316687d188 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:08.503368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:08.504250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:08.504609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:08.504918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] PATH_INFO: `/v3/users/e72f06115ec34fe69ab3a4e0be86a609` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:08.507130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72f06115ec34fe69ab3a4e0be86a609)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:08.508203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:08.718090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72f06115ec34fe69ab3a4e0be86a609'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.726627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72f06115ec34fe69ab3a4e0be86a609'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.728300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72f06115ec34fe69ab3a4e0be86a609'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.742237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72f06115ec34fe69ab3a4e0be86a609'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.806838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e962ed85-f76e-4ca9-9ddd-4d22e6cfb421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72f06115ec34fe69ab3a4e0be86a609'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:08.817891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1076/2188] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:08 2022] DELETE /identity/v3/users/e72f06115ec34fe69ab3a4e0be86a609 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:09.058692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:09.061848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:09.078819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299586f6-0c2e-4703-aaf0-af0f7c64be7b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:09.149610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:09.150501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:09.150786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:09.151065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] PATH_INFO: `/v3/projects/6f163c700bdb4419a3042ab4a474dc8d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:09.152299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f163c700bdb4419a3042ab4a474dc8d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:09.154378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:09.290706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f163c700bdb4419a3042ab4a474dc8d', 'request_id': 'req-e4fc8add-4b4d-415d-bf70-302b8d1de536'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:09.360558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:09.372510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f163c700bdb4419a3042ab4a474dc8d', 'request_id': 'req-e4fc8add-4b4d-415d-bf70-302b8d1de536'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:09.380530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f163c700bdb4419a3042ab4a474dc8d', 'request_id': 'req-e4fc8add-4b4d-415d-bf70-302b8d1de536'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:09.405302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] The token cache is being invalidate because project 6f163c700bdb4419a3042ab4a474dc8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:09.405302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:09.405679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e4fc8add-4b4d-415d-bf70-302b8d1de536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:09.407261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1113/2189] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:09 2022] DELETE /identity/v3/projects/6f163c700bdb4419a3042ab4a474dc8d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:09.412028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41dca5-894a-4e68-8219-f8157974194e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:09.412501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41dca5-894a-4e68-8219-f8157974194e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:09.412615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41dca5-894a-4e68-8219-f8157974194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:09.436679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9d41dca5-894a-4e68-8219-f8157974194e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:09.438229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9d41dca5-894a-4e68-8219-f8157974194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:09.527661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1077/2190] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:09.535566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd075695-8fda-4bac-8a49-19b0ed8e7c7f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:09.535883 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd075695-8fda-4bac-8a49-19b0ed8e7c7f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:09.536160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd075695-8fda-4bac-8a49-19b0ed8e7c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:09.556834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-fd075695-8fda-4bac-8a49-19b0ed8e7c7f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:09.558038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fd075695-8fda-4bac-8a49-19b0ed8e7c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:09.566960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1114/2191] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:09.571952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41dca5-894a-4e68-8219-f8157974194e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:09.584714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41dca5-894a-4e68-8219-f8157974194e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:09.590397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745202c1-16c7-4eaa-b480-32828d7697a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:09.591235 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745202c1-16c7-4eaa-b480-32828d7697a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:09.591726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745202c1-16c7-4eaa-b480-32828d7697a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:09.592010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745202c1-16c7-4eaa-b480-32828d7697a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:09.592934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745202c1-16c7-4eaa-b480-32828d7697a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:24:09.593246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745202c1-16c7-4eaa-b480-32828d7697a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:09.594883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745202c1-16c7-4eaa-b480-32828d7697a9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:09.618498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1078/2192] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:24:09.625394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd075695-8fda-4bac-8a49-19b0ed8e7c7f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:09.636951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd075695-8fda-4bac-8a49-19b0ed8e7c7f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:09.646059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b783-8d1c-46ee-871b-f52ad271b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:09.647364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b783-8d1c-46ee-871b-f52ad271b5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:09.648574 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b783-8d1c-46ee-871b-f52ad271b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:09.649166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b783-8d1c-46ee-871b-f52ad271b5b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:09.651014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03b783-8d1c-46ee-871b-f52ad271b5b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:09.653688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03b783-8d1c-46ee-871b-f52ad271b5b2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:09.773984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1115/2193] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:24:09 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:09.778764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745202c1-16c7-4eaa-b480-32828d7697a9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:09.789631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745202c1-16c7-4eaa-b480-32828d7697a9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:09.856371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b783-8d1c-46ee-871b-f52ad271b5b2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:09.858649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fe03b783-8d1c-46ee-871b-f52ad271b5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:09.923697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f2c3-766e-4a2a-b1a1-e68da8076942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:09.924675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f2c3-766e-4a2a-b1a1-e68da8076942 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:09.927458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f2c3-766e-4a2a-b1a1-e68da8076942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:09.927458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f2c3-766e-4a2a-b1a1-e68da8076942 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:09.933247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f2c3-766e-4a2a-b1a1-e68da8076942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:09.935211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0f2c3-766e-4a2a-b1a1-e68da8076942 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:09.958926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b783-8d1c-46ee-871b-f52ad271b5b2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:09.963977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:09.964998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:09.965381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:09.965735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] PATH_INFO: `/v3/projects/b486b27e26e94ba7adf0472d4557c592` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:09.966965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b486b27e26e94ba7adf0472d4557c592)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:09.969341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.032220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1079/2194] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:24:09 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:10.036726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f2c3-766e-4a2a-b1a1-e68da8076942 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.051381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f2c3-766e-4a2a-b1a1-e68da8076942 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.057405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b90c7-5753-4822-bacc-7263662367de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.058086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b90c7-5753-4822-bacc-7263662367de admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.058373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b90c7-5753-4822-bacc-7263662367de admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.058653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b90c7-5753-4822-bacc-7263662367de admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.059390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b90c7-5753-4822-bacc-7263662367de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.061052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b90c7-5753-4822-bacc-7263662367de admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.071823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1080/2195] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:10.075676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b90c7-5753-4822-bacc-7263662367de admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.085600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b90c7-5753-4822-bacc-7263662367de admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.090426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ed4b6-df4f-425a-8143-50509f71a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.091097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ed4b6-df4f-425a-8143-50509f71a600 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.091390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ed4b6-df4f-425a-8143-50509f71a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.091662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ed4b6-df4f-425a-8143-50509f71a600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.092415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ed4b6-df4f-425a-8143-50509f71a600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.094209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ed4b6-df4f-425a-8143-50509f71a600 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.106046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1081/2196] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:10.110146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ed4b6-df4f-425a-8143-50509f71a600 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.112961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b486b27e26e94ba7adf0472d4557c592', 'request_id': 'req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:10.121293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ed4b6-df4f-425a-8143-50509f71a600 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.184530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af170d01-54ed-4dee-87d2-7a8787a4f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.185556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170d01-54ed-4dee-87d2-7a8787a4f556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.185897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170d01-54ed-4dee-87d2-7a8787a4f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.186550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170d01-54ed-4dee-87d2-7a8787a4f556 admin admin] PATH_INFO: `/v3/projects/f77053586c4f4b5895c1327f270bc758/users/d5479bdddca94be88513250c4234df55/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.205548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170d01-54ed-4dee-87d2-7a8787a4f556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77053586c4f4b5895c1327f270bc758, user_id=d5479bdddca94be88513250c4234df55, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.208225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170d01-54ed-4dee-87d2-7a8787a4f556 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.222659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b486b27e26e94ba7adf0472d4557c592', 'request_id': 'req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:10.229239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b486b27e26e94ba7adf0472d4557c592', 'request_id': 'req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:10.240536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] The token cache is being invalidate because project b486b27e26e94ba7adf0472d4557c592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:10.240756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:10.241409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbe0a61c-19ab-4608-b5ba-afc2c3da4d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:10.243642 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1116/2197] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:09 2022] DELETE /identity/v3/projects/b486b27e26e94ba7adf0472d4557c592 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:10.249272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25eaef-fe4c-484c-baab-df0634d59453 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.249562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25eaef-fe4c-484c-baab-df0634d59453 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.249837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25eaef-fe4c-484c-baab-df0634d59453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.268565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-de25eaef-fe4c-484c-baab-df0634d59453 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:10.269785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-de25eaef-fe4c-484c-baab-df0634d59453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:10.277723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1117/2198] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:24:10.285447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970fcad-df31-47a2-a71b-ea1e2db8555f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.285735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970fcad-df31-47a2-a71b-ea1e2db8555f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.286008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970fcad-df31-47a2-a71b-ea1e2db8555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.291212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1082/2199] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:24:10 2022] PUT /identity/v3/projects/f77053586c4f4b5895c1327f270bc758/users/d5479bdddca94be88513250c4234df55/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:24:10.303035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae2d4-defe-4e26-88a8-b155ba4dba73 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.303324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae2d4-defe-4e26-88a8-b155ba4dba73 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.303582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0970fcad-df31-47a2-a71b-ea1e2db8555f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:10.303699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae2d4-defe-4e26-88a8-b155ba4dba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.305329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0970fcad-df31-47a2-a71b-ea1e2db8555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:10.333458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c11ae2d4-defe-4e26-88a8-b155ba4dba73 None None] MFA Rules not processed for user `d5479bdddca94be88513250c4234df55`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:10.334711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c11ae2d4-defe-4e26-88a8-b155ba4dba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:10.375875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1118/2200] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:24:10.380208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970fcad-df31-47a2-a71b-ea1e2db8555f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.390308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970fcad-df31-47a2-a71b-ea1e2db8555f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.395021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76a74c-0094-43bc-8ad7-9bce7fd29304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.395679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76a74c-0094-43bc-8ad7-9bce7fd29304 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.395964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76a74c-0094-43bc-8ad7-9bce7fd29304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.396239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76a74c-0094-43bc-8ad7-9bce7fd29304 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.396989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76a74c-0094-43bc-8ad7-9bce7fd29304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:24:10.397294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76a74c-0094-43bc-8ad7-9bce7fd29304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.398936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76a74c-0094-43bc-8ad7-9bce7fd29304 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.410885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1119/2201] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:24:10.415107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76a74c-0094-43bc-8ad7-9bce7fd29304 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.421722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1083/2202] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:24:10.425260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76a74c-0094-43bc-8ad7-9bce7fd29304 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.433941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae2d4-defe-4e26-88a8-b155ba4dba73 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.434078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d41200-a75d-4f7f-82eb-89a950c3aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.434733 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d41200-a75d-4f7f-82eb-89a950c3aa98 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.435015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d41200-a75d-4f7f-82eb-89a950c3aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.435291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d41200-a75d-4f7f-82eb-89a950c3aa98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.435400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c11ae2d4-defe-4e26-88a8-b155ba4dba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:10.436014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d41200-a75d-4f7f-82eb-89a950c3aa98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.438362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d41200-a75d-4f7f-82eb-89a950c3aa98 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.491101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae2d4-defe-4e26-88a8-b155ba4dba73 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.495204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56ccc4-4c54-4209-bd8f-effe43eb2664 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b95fdb06a94c1586148df32413085f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.495852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ccc4-4c54-4209-bd8f-effe43eb2664 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.496142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ccc4-4c54-4209-bd8f-effe43eb2664 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.496522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ccc4-4c54-4209-bd8f-effe43eb2664 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.507550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56ccc4-4c54-4209-bd8f-effe43eb2664 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.509723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56ccc4-4c54-4209-bd8f-effe43eb2664 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.519440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1084/2203] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:24:10.532754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1120/2204] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:24:10 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:24:10.537520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56ccc4-4c54-4209-bd8f-effe43eb2664 service glance] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.549035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56ccc4-4c54-4209-bd8f-effe43eb2664 service glance] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.594985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:10.637490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14eca2-d71d-431c-ab79-aeb9fc1ad83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.639498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14eca2-d71d-431c-ab79-aeb9fc1ad83c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.639498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14eca2-d71d-431c-ab79-aeb9fc1ad83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.642807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14eca2-d71d-431c-ab79-aeb9fc1ad83c admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.642807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14eca2-d71d-431c-ab79-aeb9fc1ad83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.644211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14eca2-d71d-431c-ab79-aeb9fc1ad83c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.790015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1085/2205] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:24:10 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:10.794268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d41200-a75d-4f7f-82eb-89a950c3aa98 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.811058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d41200-a75d-4f7f-82eb-89a950c3aa98 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.817010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715f48-5080-4a81-8d9e-5fa06e4ba3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.817690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715f48-5080-4a81-8d9e-5fa06e4ba3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.818111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715f48-5080-4a81-8d9e-5fa06e4ba3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.818398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715f48-5080-4a81-8d9e-5fa06e4ba3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.819149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715f48-5080-4a81-8d9e-5fa06e4ba3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.820897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715f48-5080-4a81-8d9e-5fa06e4ba3ef admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.832352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1121/2206] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:10.835551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14eca2-d71d-431c-ab79-aeb9fc1ad83c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.845444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14eca2-d71d-431c-ab79-aeb9fc1ad83c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.850049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0e833-f0a1-4c89-945d-9e09dbce8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.850702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0e833-f0a1-4c89-945d-9e09dbce8c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.850986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0e833-f0a1-4c89-945d-9e09dbce8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.851263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0e833-f0a1-4c89-945d-9e09dbce8c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.852587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0e833-f0a1-4c89-945d-9e09dbce8c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.854192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0e833-f0a1-4c89-945d-9e09dbce8c76 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:10.863960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1086/2207] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:10.868882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715f48-5080-4a81-8d9e-5fa06e4ba3ef admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:10.879866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715f48-5080-4a81-8d9e-5fa06e4ba3ef admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:10.885007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab442f-8b9f-4241-aeaf-ad8f07f9d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:10.885969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab442f-8b9f-4241-aeaf-ad8f07f9d629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:10.886326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab442f-8b9f-4241-aeaf-ad8f07f9d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:10.886676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab442f-8b9f-4241-aeaf-ad8f07f9d629 admin admin] PATH_INFO: `/v3/projects/0201e7c6a7f34e7dabe7cd73c246ea95/users/811a5e81a2a246b3ba2151e6ecaa3926/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:10.902223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab442f-8b9f-4241-aeaf-ad8f07f9d629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0201e7c6a7f34e7dabe7cd73c246ea95, user_id=811a5e81a2a246b3ba2151e6ecaa3926, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:10.905186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab442f-8b9f-4241-aeaf-ad8f07f9d629 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:11.007981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1122/2208] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:24:10 2022] PUT /identity/v3/projects/0201e7c6a7f34e7dabe7cd73c246ea95/users/811a5e81a2a246b3ba2151e6ecaa3926/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:11.019169 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81c5a5-2ac4-487f-b661-2a188ce2e92a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:11.019460 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81c5a5-2ac4-487f-b661-2a188ce2e92a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:11.019786 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81c5a5-2ac4-487f-b661-2a188ce2e92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:11.050535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9c81c5a5-2ac4-487f-b661-2a188ce2e92a None None] MFA Rules not processed for user `811a5e81a2a246b3ba2151e6ecaa3926`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:11.052470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9c81c5a5-2ac4-487f-b661-2a188ce2e92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:11.128391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1087/2209] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:11.131818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab442f-8b9f-4241-aeaf-ad8f07f9d629 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:11.198643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab442f-8b9f-4241-aeaf-ad8f07f9d629 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:11.203892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd9a63-8304-47db-8bda-206f6b8ce717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:11.209370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd9a63-8304-47db-8bda-206f6b8ce717 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:11.209635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd9a63-8304-47db-8bda-206f6b8ce717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:11.210276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd9a63-8304-47db-8bda-206f6b8ce717 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:11.211792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd9a63-8304-47db-8bda-206f6b8ce717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:11.214546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd9a63-8304-47db-8bda-206f6b8ce717 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:11.312740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1123/2210] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:24:11 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:24:11.314729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81c5a5-2ac4-487f-b661-2a188ce2e92a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:11.326438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81c5a5-2ac4-487f-b661-2a188ce2e92a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:11.386629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b63d96-9f95-4e2e-ac1d-176de6e39b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:11.387396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b63d96-9f95-4e2e-ac1d-176de6e39b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:11.387785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b63d96-9f95-4e2e-ac1d-176de6e39b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:11.388170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b63d96-9f95-4e2e-ac1d-176de6e39b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:11.388984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b63d96-9f95-4e2e-ac1d-176de6e39b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:11.391337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b63d96-9f95-4e2e-ac1d-176de6e39b0a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:11.532948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1088/2211] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:24:11 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:11.536930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd9a63-8304-47db-8bda-206f6b8ce717 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:11.547286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd9a63-8304-47db-8bda-206f6b8ce717 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:11.552035 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de0ca0-6797-48d7-8d81-2bf36433d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:11.552731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de0ca0-6797-48d7-8d81-2bf36433d810 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:11.553024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de0ca0-6797-48d7-8d81-2bf36433d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:11.553302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de0ca0-6797-48d7-8d81-2bf36433d810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:11.554082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de0ca0-6797-48d7-8d81-2bf36433d810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:11.555747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de0ca0-6797-48d7-8d81-2bf36433d810 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:11.568343 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1124/2212] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:24:11.572027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b63d96-9f95-4e2e-ac1d-176de6e39b0a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:11.582273 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b63d96-9f95-4e2e-ac1d-176de6e39b0a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:11.587601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a14ce4-e899-4ec3-8f07-5fba70269004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:11.588700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14ce4-e899-4ec3-8f07-5fba70269004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:11.589214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14ce4-e899-4ec3-8f07-5fba70269004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:11.589577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a14ce4-e899-4ec3-8f07-5fba70269004 admin admin] PATH_INFO: `/v3/projects/3c170dfaa41c475a894184f3d36a0876/users/57ee200e54df4b4d8397b0eea34adfaf/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:11.607860 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a14ce4-e899-4ec3-8f07-5fba70269004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c170dfaa41c475a894184f3d36a0876, user_id=57ee200e54df4b4d8397b0eea34adfaf, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:11.611038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a14ce4-e899-4ec3-8f07-5fba70269004 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:11.622716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:11.687463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1089/2213] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:24:11 2022] PUT /identity/v3/projects/3c170dfaa41c475a894184f3d36a0876/users/57ee200e54df4b4d8397b0eea34adfaf/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:11.691569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de0ca0-6797-48d7-8d81-2bf36433d810 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:11.702129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de0ca0-6797-48d7-8d81-2bf36433d810 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:11.759345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfe0de-554b-41f5-b338-c479a7817f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:11.760017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfe0de-554b-41f5-b338-c479a7817f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:11.760301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfe0de-554b-41f5-b338-c479a7817f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:11.760608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfe0de-554b-41f5-b338-c479a7817f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:11.761370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfe0de-554b-41f5-b338-c479a7817f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:11.763067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfe0de-554b-41f5-b338-c479a7817f99 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:11.773151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1125/2214] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:11.777335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a14ce4-e899-4ec3-8f07-5fba70269004 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:11.787870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a14ce4-e899-4ec3-8f07-5fba70269004 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:11.792969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b8f7-4a62-4f15-b414-dabfd6eb490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:11.793948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b8f7-4a62-4f15-b414-dabfd6eb490c admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:11.794232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b8f7-4a62-4f15-b414-dabfd6eb490c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:11.794514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b8f7-4a62-4f15-b414-dabfd6eb490c admin admin] PATH_INFO: `/v3/projects/3c170dfaa41c475a894184f3d36a0876/users/57ee200e54df4b4d8397b0eea34adfaf/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:11.796629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b8f7-4a62-4f15-b414-dabfd6eb490c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c170dfaa41c475a894184f3d36a0876, user_id=57ee200e54df4b4d8397b0eea34adfaf, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:11.799483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b8f7-4a62-4f15-b414-dabfd6eb490c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:11.811133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1090/2215] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:24:11 2022] PUT /identity/v3/projects/3c170dfaa41c475a894184f3d36a0876/users/57ee200e54df4b4d8397b0eea34adfaf/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:11.823015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea7b4b-b332-41aa-9e10-a6c2ab792b0b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:11.823324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea7b4b-b332-41aa-9e10-a6c2ab792b0b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:11.823630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea7b4b-b332-41aa-9e10-a6c2ab792b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:11.850818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-25ea7b4b-b332-41aa-9e10-a6c2ab792b0b None None] MFA Rules not processed for user `57ee200e54df4b4d8397b0eea34adfaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:11.852239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-25ea7b4b-b332-41aa-9e10-a6c2ab792b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:11.932334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:11.936542 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1126/2216] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:11.949150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b8f7-4a62-4f15-b414-dabfd6eb490c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:11.950936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6bb7b8f7-4a62-4f15-b414-dabfd6eb490c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:12.010169 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b8f7-4a62-4f15-b414-dabfd6eb490c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:12.015258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d02d3a-2722-4825-8197-ef24b3fbf0f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:12.016100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d02d3a-2722-4825-8197-ef24b3fbf0f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:12.016424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d02d3a-2722-4825-8197-ef24b3fbf0f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:12.016700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d02d3a-2722-4825-8197-ef24b3fbf0f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:12.076824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d02d3a-2722-4825-8197-ef24b3fbf0f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:12.078280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d02d3a-2722-4825-8197-ef24b3fbf0f0 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:12.087566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1091/2217] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:13.914728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:14.405962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:15.491133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:15.914717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:16.599904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:16.836924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:17.879951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:18.016529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:18.537426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea7b4b-b332-41aa-9e10-a6c2ab792b0b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:18.538920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-25ea7b4b-b332-41aa-9e10-a6c2ab792b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:18.552017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea7b4b-b332-41aa-9e10-a6c2ab792b0b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:18.556374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c642358-5b26-47c5-8571-36c189fc0644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:18.560468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c642358-5b26-47c5-8571-36c189fc0644 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:18.560468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c642358-5b26-47c5-8571-36c189fc0644 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:18.560468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c642358-5b26-47c5-8571-36c189fc0644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:18.568519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c642358-5b26-47c5-8571-36c189fc0644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:18.571537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c642358-5b26-47c5-8571-36c189fc0644 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:18.585632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1127/2218] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:18.686589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:19.422668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:19.885402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:20.704818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:22.194208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:22.402336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:22.702806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:23.215934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:23.434271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:24.175629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d02d3a-2722-4825-8197-ef24b3fbf0f0 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:24.183919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d02d3a-2722-4825-8197-ef24b3fbf0f0 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:24.187861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8623d-0015-4114-9176-8790390b3882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:24.191478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8623d-0015-4114-9176-8790390b3882 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:24.191478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8623d-0015-4114-9176-8790390b3882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:24.191478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8623d-0015-4114-9176-8790390b3882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:24.191478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9aa8623d-0015-4114-9176-8790390b3882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:24.253630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8623d-0015-4114-9176-8790390b3882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:24.255077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8623d-0015-4114-9176-8790390b3882 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:24.265572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1092/2219] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:24.497049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:24.577287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:25.086448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:25.114005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:25.126740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c642358-5b26-47c5-8571-36c189fc0644 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:25.191443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c642358-5b26-47c5-8571-36c189fc0644 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:25.196078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:25.197511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:25.197805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:25.198112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] PATH_INFO: `/v3/users/811a5e81a2a246b3ba2151e6ecaa3926` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:25.199479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=811a5e81a2a246b3ba2151e6ecaa3926)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:25.201470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:25.417516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811a5e81a2a246b3ba2151e6ecaa3926'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:25.418217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811a5e81a2a246b3ba2151e6ecaa3926'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:25.427958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811a5e81a2a246b3ba2151e6ecaa3926'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:25.428730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811a5e81a2a246b3ba2151e6ecaa3926'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:25.444585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811a5e81a2a246b3ba2151e6ecaa3926'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:25.533611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:25.537544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1128/2220] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:25 2022] DELETE /identity/v3/users/811a5e81a2a246b3ba2151e6ecaa3926 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:25.544976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6accec-8bd6-4a75-9720-721ec26b9566 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:25.545291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6accec-8bd6-4a75-9720-721ec26b9566 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:25.545603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6accec-8bd6-4a75-9720-721ec26b9566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:25.564615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-cc6accec-8bd6-4a75-9720-721ec26b9566 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:25.570287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cc6accec-8bd6-4a75-9720-721ec26b9566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:25.617538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:25.635714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1093/2221] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:25.648452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:25.648452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:25.717994 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe7d99-633f-4c87-bb19-c18f033247bd admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:25.721627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1206d-4b5b-410a-8bdf-49bdb0eedad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:25.722279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1206d-4b5b-410a-8bdf-49bdb0eedad4 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:25.722559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1206d-4b5b-410a-8bdf-49bdb0eedad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:25.722835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1206d-4b5b-410a-8bdf-49bdb0eedad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:25.739155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1206d-4b5b-410a-8bdf-49bdb0eedad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:25.741039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1206d-4b5b-410a-8bdf-49bdb0eedad4 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:25.751884 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1129/2222] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:25.902654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:25.995421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:26.201695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6accec-8bd6-4a75-9720-721ec26b9566 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:26.203381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cc6accec-8bd6-4a75-9720-721ec26b9566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:26.216682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6accec-8bd6-4a75-9720-721ec26b9566 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:26.217518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:26.221718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:26.227757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:26.227757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:26.227757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] PATH_INFO: `/v3/projects/0201e7c6a7f34e7dabe7cd73c246ea95` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:26.227757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0201e7c6a7f34e7dabe7cd73c246ea95)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:26.227757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:26.246852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:26.375770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0201e7c6a7f34e7dabe7cd73c246ea95', 'request_id': 'req-4792e187-59ca-4796-b111-863c0e2c8fd8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.457649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0201e7c6a7f34e7dabe7cd73c246ea95', 'request_id': 'req-4792e187-59ca-4796-b111-863c0e2c8fd8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.465178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0201e7c6a7f34e7dabe7cd73c246ea95', 'request_id': 'req-4792e187-59ca-4796-b111-863c0e2c8fd8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.478834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] The token cache is being invalidate because project 0201e7c6a7f34e7dabe7cd73c246ea95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:26.479122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.479914 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.484213 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1094/2223] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:26 2022] DELETE /identity/v3/projects/0201e7c6a7f34e7dabe7cd73c246ea95 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:26.485430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1206d-4b5b-410a-8bdf-49bdb0eedad4 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:26.495493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1206d-4b5b-410a-8bdf-49bdb0eedad4 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:26.555459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:26.556914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:26.557193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:26.557468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] PATH_INFO: `/v3/users/57ee200e54df4b4d8397b0eea34adfaf` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:26.558650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ee200e54df4b4d8397b0eea34adfaf)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:26.560571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:26.567105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:26.588759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:26.732969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ee200e54df4b4d8397b0eea34adfaf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.733631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ee200e54df4b4d8397b0eea34adfaf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.740428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ee200e54df4b4d8397b0eea34adfaf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.741058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ee200e54df4b4d8397b0eea34adfaf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.753557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0f74fed3-fcac-4ce9-af7a-c8d1cead01a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ee200e54df4b4d8397b0eea34adfaf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:26.759133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:26.857295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:26.894965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1130/2224] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:26 2022] DELETE /identity/v3/users/57ee200e54df4b4d8397b0eea34adfaf => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:24:27.137048 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:27.379755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:27.382024 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:27.405798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792e187-59ca-4796-b111-863c0e2c8fd8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:27.483985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:27.485205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:27.485651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:27.486099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] PATH_INFO: `/v3/projects/3c170dfaa41c475a894184f3d36a0876` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:27.487519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c170dfaa41c475a894184f3d36a0876)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:27.489520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:27.639372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c170dfaa41c475a894184f3d36a0876', 'request_id': 'req-0883f2cf-1227-486e-9c4d-b1b011f6f580'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:27.667353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:27.932066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c170dfaa41c475a894184f3d36a0876', 'request_id': 'req-0883f2cf-1227-486e-9c4d-b1b011f6f580'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:27.942519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c170dfaa41c475a894184f3d36a0876', 'request_id': 'req-0883f2cf-1227-486e-9c4d-b1b011f6f580'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:27.956891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] The token cache is being invalidate because project 3c170dfaa41c475a894184f3d36a0876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:27.957253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:27.958463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:27.960555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1095/2225] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:27 2022] DELETE /identity/v3/projects/3c170dfaa41c475a894184f3d36a0876 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:28.110173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:28.265633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:28.440371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:28.703451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:28.728924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:28.856994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:28.873974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:29.079859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:29.348707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:29.400935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:29.662781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:29.959858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:30.068221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:30.097712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:30.348956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:30.418064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:30.565654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:30.686111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:30.960146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:31.172262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9b774-2a8e-46ac-8151-a93de5fa69c3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:31.172591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9b774-2a8e-46ac-8151-a93de5fa69c3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:31.172869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9b774-2a8e-46ac-8151-a93de5fa69c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:31.201558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b7d9b774-2a8e-46ac-8151-a93de5fa69c3 None None] MFA Rules not processed for user `0413e7978b554cfba4902761836b8895`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:31.202764 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b7d9b774-2a8e-46ac-8151-a93de5fa69c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:31.291520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1131/2226] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:24:40.473874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:40.475304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:40.596410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883f2cf-1227-486e-9c4d-b1b011f6f580 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:40.601173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:40.602046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:40.602336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:40.602615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] PATH_INFO: `/v3/users/d5479bdddca94be88513250c4234df55` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:40.604529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5479bdddca94be88513250c4234df55)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:40.606489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:40.775681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:40.785415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5479bdddca94be88513250c4234df55'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:40.794277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5479bdddca94be88513250c4234df55'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:40.796201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5479bdddca94be88513250c4234df55'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:40.821682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5479bdddca94be88513250c4234df55'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:40.908002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5479bdddca94be88513250c4234df55'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:40.914695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1096/2227] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:40 2022] DELETE /identity/v3/users/d5479bdddca94be88513250c4234df55 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:40.920114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914f5e-35bd-4162-854c-a7c68cf42852 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:40.920597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914f5e-35bd-4162-854c-a7c68cf42852 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:40.920723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914f5e-35bd-4162-854c-a7c68cf42852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:40.950416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d6914f5e-35bd-4162-854c-a7c68cf42852 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:40.951877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d6914f5e-35bd-4162-854c-a7c68cf42852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:41.005736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:41.024427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1132/2228] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:41.035333 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:41.036909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:41.134939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dfd65-d49d-46df-a60c-ec36a2abf42c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:41.138958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ede06a-648f-4a5e-b76b-10a28cf7547c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:41.139597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ede06a-648f-4a5e-b76b-10a28cf7547c service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:41.139877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ede06a-648f-4a5e-b76b-10a28cf7547c service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:41.142537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ede06a-648f-4a5e-b76b-10a28cf7547c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:41.151139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ede06a-648f-4a5e-b76b-10a28cf7547c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:41.152769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ede06a-648f-4a5e-b76b-10a28cf7547c service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:41.164002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1097/2229] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:41.606904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914f5e-35bd-4162-854c-a7c68cf42852 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:41.612998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d6914f5e-35bd-4162-854c-a7c68cf42852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:41.620590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914f5e-35bd-4162-854c-a7c68cf42852 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:41.625394 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:41.626255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:41.626540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:41.626821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] PATH_INFO: `/v3/projects/f77053586c4f4b5895c1327f270bc758` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:41.628141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77053586c4f4b5895c1327f270bc758)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:41.630005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:41.804220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77053586c4f4b5895c1327f270bc758', 'request_id': 'req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:41.856877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77053586c4f4b5895c1327f270bc758', 'request_id': 'req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:41.863970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77053586c4f4b5895c1327f270bc758', 'request_id': 'req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:41.876947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] The token cache is being invalidate because project f77053586c4f4b5895c1327f270bc758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:41.877242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:41.877942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:41.879670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1133/2230] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:41 2022] DELETE /identity/v3/projects/f77053586c4f4b5895c1327f270bc758 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:51.158831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=58,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:51.491451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ede06a-648f-4a5e-b76b-10a28cf7547c service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:51.492878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d3ede06a-648f-4a5e-b76b-10a28cf7547c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:51.506561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ede06a-648f-4a5e-b76b-10a28cf7547c service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:51.562948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:51.563824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:51.564109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:51.564420 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] PATH_INFO: `/v3/users/b7dca72f701840d88253b6ca90b886e5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:51.565607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7dca72f701840d88253b6ca90b886e5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:51.567559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:51.664029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:51.667695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:51.698515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc4eb1-0bbb-43e1-b8d7-ffdf0a7390a5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:51.703677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:51.704685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:51.705080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:51.705775 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] PATH_INFO: `/v3/users/2b2feeae716a4f0899a6a914cb603bca` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:51.707071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2feeae716a4f0899a6a914cb603bca)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:51.709310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:51.814812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7dca72f701840d88253b6ca90b886e5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:51.822205 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7dca72f701840d88253b6ca90b886e5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:51.822890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7dca72f701840d88253b6ca90b886e5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:51.834986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7dca72f701840d88253b6ca90b886e5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:51.924382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e84e5bda-c780-44e6-943c-75d512e48e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7dca72f701840d88253b6ca90b886e5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:51.931092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1098/2231] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:51 2022] DELETE /identity/v3/users/b7dca72f701840d88253b6ca90b886e5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:51.935933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899863da-d8c3-443f-a7ee-5b8e83f145ea None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:51.936573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899863da-d8c3-443f-a7ee-5b8e83f145ea None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:51.936676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899863da-d8c3-443f-a7ee-5b8e83f145ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:51.956405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-899863da-d8c3-443f-a7ee-5b8e83f145ea None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:51.957805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-899863da-d8c3-443f-a7ee-5b8e83f145ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:51.971814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2feeae716a4f0899a6a914cb603bca'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:51.972735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2feeae716a4f0899a6a914cb603bca'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:51.981538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2feeae716a4f0899a6a914cb603bca'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:51.982237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2feeae716a4f0899a6a914cb603bca'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:51.996590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2feeae716a4f0899a6a914cb603bca'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:52.020192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1099/2232] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:24:52.029822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899863da-d8c3-443f-a7ee-5b8e83f145ea None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:52.033654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-899863da-d8c3-443f-a7ee-5b8e83f145ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:52.053685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:52.090042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899863da-d8c3-443f-a7ee-5b8e83f145ea None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:52.093720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bd098-e0cb-4b75-8899-19f33cb8e50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:52.094424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd098-e0cb-4b75-8899-19f33cb8e50e service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:52.094735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd098-e0cb-4b75-8899-19f33cb8e50e service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:52.095018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bd098-e0cb-4b75-8899-19f33cb8e50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:52.106802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bd098-e0cb-4b75-8899-19f33cb8e50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:52.111673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bd098-e0cb-4b75-8899-19f33cb8e50e service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:52.111796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1134/2233] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:51 2022] DELETE /identity/v3/users/2b2feeae716a4f0899a6a914cb603bca => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:52.119185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1100/2234] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:24:52.561754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:52.563901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:52.626468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:52.640212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a13d1-9f39-42a3-a159-61f2bf61cfc3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:52.645246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:52.646050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:52.646332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:52.646604 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] PATH_INFO: `/v3/projects/2413b4952f614e9cb13874e14e73345f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:52.647805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2413b4952f614e9cb13874e14e73345f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:52.649790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:52.731592 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bd098-e0cb-4b75-8899-19f33cb8e50e service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:52.733083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-299bd098-e0cb-4b75-8899-19f33cb8e50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:52.752229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bd098-e0cb-4b75-8899-19f33cb8e50e service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:52.755369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:52.756254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:52.756568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:52.756849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] PATH_INFO: `/v3/projects/e945118c79424c2a8dff352d5fb102d2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:52.758251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e945118c79424c2a8dff352d5fb102d2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:52.760703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:52.772946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2413b4952f614e9cb13874e14e73345f', 'request_id': 'req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:52.868157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2413b4952f614e9cb13874e14e73345f', 'request_id': 'req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:52.879530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2413b4952f614e9cb13874e14e73345f', 'request_id': 'req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:52.896977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] The token cache is being invalidate because project 2413b4952f614e9cb13874e14e73345f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:52.897266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:52.897387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e945118c79424c2a8dff352d5fb102d2', 'request_id': 'req-dbd7f55d-2712-4330-839e-c6795ccfb3ae'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:52.897951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:52.903034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1135/2235] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:52 2022] DELETE /identity/v3/projects/2413b4952f614e9cb13874e14e73345f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:52.904002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:52.905446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:52.983451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f695c-2c9c-4167-aae8-335e7f9a9e53 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:52.999684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e945118c79424c2a8dff352d5fb102d2', 'request_id': 'req-dbd7f55d-2712-4330-839e-c6795ccfb3ae'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.007637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e945118c79424c2a8dff352d5fb102d2', 'request_id': 'req-dbd7f55d-2712-4330-839e-c6795ccfb3ae'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.024751 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] The token cache is being invalidate because project e945118c79424c2a8dff352d5fb102d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:53.025479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.026081 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-dbd7f55d-2712-4330-839e-c6795ccfb3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.029000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1101/2236] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:52 2022] DELETE /identity/v3/projects/e945118c79424c2a8dff352d5fb102d2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:24:53.043017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97910696-7a51-4a02-b7f4-65f83e584a03 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.043017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97910696-7a51-4a02-b7f4-65f83e584a03 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.043017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97910696-7a51-4a02-b7f4-65f83e584a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.062007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:53.063277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.063685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.064147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] PATH_INFO: `/v3/users/dddeab201f17411998952f405f0ee47d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.067074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddeab201f17411998952f405f0ee47d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:53.068948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:53.103698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-97910696-7a51-4a02-b7f4-65f83e584a03 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:53.105031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-97910696-7a51-4a02-b7f4-65f83e584a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:53.113077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1102/2237] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:24:53.123445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08391665-fa71-4ed5-b2cf-665339bf764c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.123733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08391665-fa71-4ed5-b2cf-665339bf764c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.124016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08391665-fa71-4ed5-b2cf-665339bf764c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.143137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-08391665-fa71-4ed5-b2cf-665339bf764c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:53.145789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-08391665-fa71-4ed5-b2cf-665339bf764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:53.152223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1103/2238] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:24:53.156074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08391665-fa71-4ed5-b2cf-665339bf764c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:53.164964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08391665-fa71-4ed5-b2cf-665339bf764c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:53.169512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d95c40-804d-4dee-b848-2da98ba58fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:53.170139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d95c40-804d-4dee-b848-2da98ba58fff admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.170465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d95c40-804d-4dee-b848-2da98ba58fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.170692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d95c40-804d-4dee-b848-2da98ba58fff admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.171441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d95c40-804d-4dee-b848-2da98ba58fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:24:53.171747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d95c40-804d-4dee-b848-2da98ba58fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:53.173412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d95c40-804d-4dee-b848-2da98ba58fff admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:53.185295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1104/2239] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:24:53.189470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d95c40-804d-4dee-b848-2da98ba58fff admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:53.196241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:53.202708 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d95c40-804d-4dee-b848-2da98ba58fff admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:53.205974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdebe1e-92c9-4d86-ac03-5be74ee2b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:53.206734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdebe1e-92c9-4d86-ac03-5be74ee2b822 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.207020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdebe1e-92c9-4d86-ac03-5be74ee2b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.207318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdebe1e-92c9-4d86-ac03-5be74ee2b822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.207998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdebe1e-92c9-4d86-ac03-5be74ee2b822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:53.209951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdebe1e-92c9-4d86-ac03-5be74ee2b822 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:53.304106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1105/2240] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:24:53 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:24:53.308861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdebe1e-92c9-4d86-ac03-5be74ee2b822 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:53.312756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddeab201f17411998952f405f0ee47d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.313462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddeab201f17411998952f405f0ee47d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.320584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddeab201f17411998952f405f0ee47d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.321278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddeab201f17411998952f405f0ee47d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.334594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddeab201f17411998952f405f0ee47d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.342566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:53.369260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdebe1e-92c9-4d86-ac03-5be74ee2b822 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:53.374508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb3078-0ae0-4d86-a5c9-9d9a0e17ac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:53.375211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3078-0ae0-4d86-a5c9-9d9a0e17ac54 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.375465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3078-0ae0-4d86-a5c9-9d9a0e17ac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.375745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3078-0ae0-4d86-a5c9-9d9a0e17ac54 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.376461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb3078-0ae0-4d86-a5c9-9d9a0e17ac54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:53.378398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb3078-0ae0-4d86-a5c9-9d9a0e17ac54 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:53.418586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1136/2241] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:24:52 2022] DELETE /identity/v3/users/dddeab201f17411998952f405f0ee47d => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:53.435766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1106/2242] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:24:53 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:24:53.439878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:53.441773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:53.509704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267c7e2-94ba-4fff-a91c-619add829763 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:53.516507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3ca1b-5f97-4783-a198-014a2b7052ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:53.516507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ca1b-5f97-4783-a198-014a2b7052ff admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.516753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ca1b-5f97-4783-a198-014a2b7052ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.517115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ca1b-5f97-4783-a198-014a2b7052ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.518324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ca1b-5f97-4783-a198-014a2b7052ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:53.519456 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ca1b-5f97-4783-a198-014a2b7052ff admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:53.532744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1137/2243] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:53.536880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb3078-0ae0-4d86-a5c9-9d9a0e17ac54 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:53.550377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb3078-0ae0-4d86-a5c9-9d9a0e17ac54 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:53.560935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74299d97-1115-4a87-b5f7-ec7495ea2d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:53.561818 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299d97-1115-4a87-b5f7-ec7495ea2d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.562254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299d97-1115-4a87-b5f7-ec7495ea2d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.562950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299d97-1115-4a87-b5f7-ec7495ea2d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.563820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74299d97-1115-4a87-b5f7-ec7495ea2d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:53.565629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74299d97-1115-4a87-b5f7-ec7495ea2d9d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:53.580647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1107/2244] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:53.583451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3ca1b-5f97-4783-a198-014a2b7052ff admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:53.599214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3ca1b-5f97-4783-a198-014a2b7052ff admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:53.605010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc5df7-143b-4584-a6e3-c22d67946075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:53.605894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc5df7-143b-4584-a6e3-c22d67946075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.606189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc5df7-143b-4584-a6e3-c22d67946075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.606472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc5df7-143b-4584-a6e3-c22d67946075 admin admin] PATH_INFO: `/v3/projects/02ccdd3200804ea0858ccacff8843931/users/9b24429c27a34f85b4f463ca1434a010/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.621950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc5df7-143b-4584-a6e3-c22d67946075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ccdd3200804ea0858ccacff8843931, user_id=9b24429c27a34f85b4f463ca1434a010, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:53.624666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc5df7-143b-4584-a6e3-c22d67946075 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:53.683260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74299d97-1115-4a87-b5f7-ec7495ea2d9d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:53.683260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-74299d97-1115-4a87-b5f7-ec7495ea2d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:53.696120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74299d97-1115-4a87-b5f7-ec7495ea2d9d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:53.701579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:53.702457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.702745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.703083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] PATH_INFO: `/v3/projects/0912dcc2043e4ae99b28f070018d7aee` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.704940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0912dcc2043e4ae99b28f070018d7aee)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:53.707417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:53.713718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1138/2245] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:24:53 2022] PUT /identity/v3/projects/02ccdd3200804ea0858ccacff8843931/users/9b24429c27a34f85b4f463ca1434a010/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:53.723622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64abd0-2c0a-4374-b146-4194c6f0303d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.723911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64abd0-2c0a-4374-b146-4194c6f0303d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.724193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64abd0-2c0a-4374-b146-4194c6f0303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.753495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ec64abd0-2c0a-4374-b146-4194c6f0303d None None] MFA Rules not processed for user `9b24429c27a34f85b4f463ca1434a010`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:53.754739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ec64abd0-2c0a-4374-b146-4194c6f0303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:53.822016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1139/2246] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:53.832630 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64abd0-2c0a-4374-b146-4194c6f0303d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:53.834321 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ec64abd0-2c0a-4374-b146-4194c6f0303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:53.839763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0912dcc2043e4ae99b28f070018d7aee', 'request_id': 'req-a19cd57c-6f03-4887-b61c-dae2edea0300'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.841058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:53.890867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64abd0-2c0a-4374-b146-4194c6f0303d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:53.902831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0912dcc2043e4ae99b28f070018d7aee', 'request_id': 'req-a19cd57c-6f03-4887-b61c-dae2edea0300'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.912625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0912dcc2043e4ae99b28f070018d7aee', 'request_id': 'req-a19cd57c-6f03-4887-b61c-dae2edea0300'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.934662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] The token cache is being invalidate because project 0912dcc2043e4ae99b28f070018d7aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:24:53.935014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.935999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a19cd57c-6f03-4887-b61c-dae2edea0300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:24:53.938100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1108/2247] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:24:53 2022] DELETE /identity/v3/projects/0912dcc2043e4ae99b28f070018d7aee => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:24:53.943339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66292242-762d-4c56-81a2-14faeeee577c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.943630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66292242-762d-4c56-81a2-14faeeee577c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.943909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66292242-762d-4c56-81a2-14faeeee577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.945126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd4d3e-5cf2-45a6-90df-10001f70707b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:53.945788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd4d3e-5cf2-45a6-90df-10001f70707b service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:53.946078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd4d3e-5cf2-45a6-90df-10001f70707b service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:53.946363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd4d3e-5cf2-45a6-90df-10001f70707b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:53.948133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a9dd4d3e-5cf2-45a6-90df-10001f70707b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:53.964123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-66292242-762d-4c56-81a2-14faeeee577c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:53.965351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-66292242-762d-4c56-81a2-14faeeee577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:54.012261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd4d3e-5cf2-45a6-90df-10001f70707b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:54.014029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd4d3e-5cf2-45a6-90df-10001f70707b service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:54.023250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1140/2248] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:24:54.028075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1109/2249] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:54.036606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9ca0d-c04a-4562-bc14-c55942049d1d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:54.037037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9ca0d-c04a-4562-bc14-c55942049d1d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:54.037541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9ca0d-c04a-4562-bc14-c55942049d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:54.060569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-eca9ca0d-c04a-4562-bc14-c55942049d1d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:54.060569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-eca9ca0d-c04a-4562-bc14-c55942049d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:54.069531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1141/2250] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:54.074142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66292242-762d-4c56-81a2-14faeeee577c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:54.084228 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66292242-762d-4c56-81a2-14faeeee577c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:54.089630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32623de2-6c49-4de3-83ce-41e2a9c94e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:54.090292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32623de2-6c49-4de3-83ce-41e2a9c94e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:54.090927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32623de2-6c49-4de3-83ce-41e2a9c94e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:54.090927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32623de2-6c49-4de3-83ce-41e2a9c94e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:54.091555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32623de2-6c49-4de3-83ce-41e2a9c94e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:24:54.091872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32623de2-6c49-4de3-83ce-41e2a9c94e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:54.093499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32623de2-6c49-4de3-83ce-41e2a9c94e40 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:54.112444 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1110/2251] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:24:54.116056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9ca0d-c04a-4562-bc14-c55942049d1d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:54.127312 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9ca0d-c04a-4562-bc14-c55942049d1d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:54.132470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7a57-e80a-4686-a090-4e6253da2f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:54.133130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7a57-e80a-4686-a090-4e6253da2f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:54.133413 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7a57-e80a-4686-a090-4e6253da2f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:54.133689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a7a57-e80a-4686-a090-4e6253da2f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:54.134377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7a57-e80a-4686-a090-4e6253da2f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:54.136854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a7a57-e80a-4686-a090-4e6253da2f14 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:54.239032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1142/2252] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:24:54 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:54.239979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32623de2-6c49-4de3-83ce-41e2a9c94e40 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:54.254602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32623de2-6c49-4de3-83ce-41e2a9c94e40 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:54.275288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:54.314764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf2c7d-6f30-4d82-aadf-00ddff23d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:54.315410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf2c7d-6f30-4d82-aadf-00ddff23d06f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:54.315693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf2c7d-6f30-4d82-aadf-00ddff23d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:54.315969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf2c7d-6f30-4d82-aadf-00ddff23d06f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:54.316722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf2c7d-6f30-4d82-aadf-00ddff23d06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:54.318737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf2c7d-6f30-4d82-aadf-00ddff23d06f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:54.406470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1111/2253] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:24:54 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:24:54.410954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7a57-e80a-4686-a090-4e6253da2f14 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:54.422081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a7a57-e80a-4686-a090-4e6253da2f14 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:54.426698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667319b0-ac75-4ad6-bd65-a20c2a2d4f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:54.428266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667319b0-ac75-4ad6-bd65-a20c2a2d4f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:54.428266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667319b0-ac75-4ad6-bd65-a20c2a2d4f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:54.428266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667319b0-ac75-4ad6-bd65-a20c2a2d4f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:54.428840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667319b0-ac75-4ad6-bd65-a20c2a2d4f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:54.430681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667319b0-ac75-4ad6-bd65-a20c2a2d4f3e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:54.442118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1143/2254] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:54.446010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf2c7d-6f30-4d82-aadf-00ddff23d06f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:54.456612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf2c7d-6f30-4d82-aadf-00ddff23d06f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:54.462165 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428bbd5-d298-4afb-ac08-ee8f7e5f4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:54.463219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428bbd5-d298-4afb-ac08-ee8f7e5f4926 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:54.464400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428bbd5-d298-4afb-ac08-ee8f7e5f4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:54.464400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428bbd5-d298-4afb-ac08-ee8f7e5f4926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:54.465143 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428bbd5-d298-4afb-ac08-ee8f7e5f4926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:54.466738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428bbd5-d298-4afb-ac08-ee8f7e5f4926 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:54.477275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1112/2255] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:24:54.481416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667319b0-ac75-4ad6-bd65-a20c2a2d4f3e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:54.491212 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667319b0-ac75-4ad6-bd65-a20c2a2d4f3e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:54.496392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a89bc-433c-415e-823c-c08432996e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:54.497257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a89bc-433c-415e-823c-c08432996e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:54.497541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a89bc-433c-415e-823c-c08432996e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:54.497819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a89bc-433c-415e-823c-c08432996e56 admin admin] PATH_INFO: `/v3/projects/7f3d631c19834afd85df668eb3aaf73b/users/e479cb4c1722420cb3fe44aab5ab40b6/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:54.513126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a89bc-433c-415e-823c-c08432996e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3d631c19834afd85df668eb3aaf73b, user_id=e479cb4c1722420cb3fe44aab5ab40b6, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:54.515822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a89bc-433c-415e-823c-c08432996e56 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:54.565693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1144/2256] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:24:54 2022] PUT /identity/v3/projects/7f3d631c19834afd85df668eb3aaf73b/users/e479cb4c1722420cb3fe44aab5ab40b6/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:24:54.576427 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35213-fed4-4b5d-b80b-4cfa28b2df20 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:54.576719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35213-fed4-4b5d-b80b-4cfa28b2df20 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:54.576996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35213-fed4-4b5d-b80b-4cfa28b2df20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:54.614131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c5d35213-fed4-4b5d-b80b-4cfa28b2df20 None None] MFA Rules not processed for user `e479cb4c1722420cb3fe44aab5ab40b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:54.615351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c5d35213-fed4-4b5d-b80b-4cfa28b2df20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:54.681002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1113/2257] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:54.692789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a89bc-433c-415e-823c-c08432996e56 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:54.694488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-358a89bc-433c-415e-823c-c08432996e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:54.708886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:54.751645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a89bc-433c-415e-823c-c08432996e56 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:54.755515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262a6f-7b1f-4655-8ef7-d4695c8aa46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:54.756161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262a6f-7b1f-4655-8ef7-d4695c8aa46e service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:54.763201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262a6f-7b1f-4655-8ef7-d4695c8aa46e service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:54.763201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262a6f-7b1f-4655-8ef7-d4695c8aa46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:54.765917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37262a6f-7b1f-4655-8ef7-d4695c8aa46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:54.767339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37262a6f-7b1f-4655-8ef7-d4695c8aa46e service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:54.777172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1145/2258] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:24:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:24:55.154013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c4d2-2e23-4af7-b285-b867fa908f58 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:55.154476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c4d2-2e23-4af7-b285-b867fa908f58 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:55.154581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c4d2-2e23-4af7-b285-b867fa908f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:55.185381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bdc7c4d2-2e23-4af7-b285-b867fa908f58 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:55.186616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bdc7c4d2-2e23-4af7-b285-b867fa908f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:55.251719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1114/2259] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:24:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:24:55.315218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262a6f-7b1f-4655-8ef7-d4695c8aa46e service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:24:55.316715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-37262a6f-7b1f-4655-8ef7-d4695c8aa46e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:55.397253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262a6f-7b1f-4655-8ef7-d4695c8aa46e service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:24:55.403634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79267092-2e2c-4671-adf2-fcd9519960b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:24:55.404160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79267092-2e2c-4671-adf2-fcd9519960b4 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:55.404575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79267092-2e2c-4671-adf2-fcd9519960b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:55.404943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79267092-2e2c-4671-adf2-fcd9519960b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:55.413941 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79267092-2e2c-4671-adf2-fcd9519960b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:24:55.415610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79267092-2e2c-4671-adf2-fcd9519960b4 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:24:55.425659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1146/2260] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:24:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:24:55.719983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaecccf-7ee7-4654-ae68-49df7767ba60 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:24:55.720366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaecccf-7ee7-4654-ae68-49df7767ba60 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:24:55.720736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaecccf-7ee7-4654-ae68-49df7767ba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:24:55.740160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-eaaecccf-7ee7-4654-ae68-49df7767ba60 None None] MFA Rules not processed for user `9b24429c27a34f85b4f463ca1434a010`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:24:55.741498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-eaaecccf-7ee7-4654-ae68-49df7767ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:24:55.756418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:24:55.806617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1115/2261] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:24:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:01.675784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e717-038f-41d2-af12-9724310322f3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:01.676299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e717-038f-41d2-af12-9724310322f3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:01.676299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e717-038f-41d2-af12-9724310322f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:01.698747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4302e717-038f-41d2-af12-9724310322f3 None None] MFA Rules not processed for user `ce295e83877040b2869cd06409d93c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:01.700730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4302e717-038f-41d2-af12-9724310322f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:01.800636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1147/2262] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:02.447295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaecccf-7ee7-4654-ae68-49df7767ba60 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:02.561478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaecccf-7ee7-4654-ae68-49df7767ba60 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:02.567874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:02.569590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:02.570234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:02.570665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] PATH_INFO: `/v3/users/e479cb4c1722420cb3fe44aab5ab40b6` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:02.573080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e479cb4c1722420cb3fe44aab5ab40b6)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:02.576511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:02.760084 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e479cb4c1722420cb3fe44aab5ab40b6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:02.769955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e479cb4c1722420cb3fe44aab5ab40b6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:02.771015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e479cb4c1722420cb3fe44aab5ab40b6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:02.791562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e479cb4c1722420cb3fe44aab5ab40b6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:02.864438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e479cb4c1722420cb3fe44aab5ab40b6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:02.877373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1116/2263] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:02 2022] DELETE /identity/v3/users/e479cb4c1722420cb3fe44aab5ab40b6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:02.882293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5003-e1f0-4a5b-9ded-4479f5b2081d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:02.882820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5003-e1f0-4a5b-9ded-4479f5b2081d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:02.883255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5003-e1f0-4a5b-9ded-4479f5b2081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:02.906774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-271f5003-e1f0-4a5b-9ded-4479f5b2081d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:02.908694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-271f5003-e1f0-4a5b-9ded-4479f5b2081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:02.975050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:03.006696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1148/2264] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:03.013905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:03.015815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:03.078525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:03.091446 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b3b36-b435-4989-8978-130ee9b4ec2f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:03.096028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5279327-63c3-4532-a04e-ff3d70c7a0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:03.097180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5279327-63c3-4532-a04e-ff3d70c7a0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:03.097692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5279327-63c3-4532-a04e-ff3d70c7a0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:03.097977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5279327-63c3-4532-a04e-ff3d70c7a0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:03.108417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5279327-63c3-4532-a04e-ff3d70c7a0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:03.109901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5279327-63c3-4532-a04e-ff3d70c7a0a2 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:03.122520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1117/2265] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:03.651816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f5003-e1f0-4a5b-9ded-4479f5b2081d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:03.654219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-271f5003-e1f0-4a5b-9ded-4479f5b2081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:03.672262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f5003-e1f0-4a5b-9ded-4479f5b2081d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:03.677823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:03.678899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:03.679284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:03.679690 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] PATH_INFO: `/v3/projects/7f3d631c19834afd85df668eb3aaf73b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:03.685467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3d631c19834afd85df668eb3aaf73b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:03.690573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:03.844427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3d631c19834afd85df668eb3aaf73b', 'request_id': 'req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:03.942928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3d631c19834afd85df668eb3aaf73b', 'request_id': 'req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:03.951883 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3d631c19834afd85df668eb3aaf73b', 'request_id': 'req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:03.966728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] The token cache is being invalidate because project 7f3d631c19834afd85df668eb3aaf73b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:03.967021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:03.967978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5524da0c-7b34-4c58-b1ce-425bca0bb8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:03.974975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7f55a-d8e5-41ae-8455-8ecde0733d73 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:03.975978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7f55a-d8e5-41ae-8455-8ecde0733d73 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:03.976650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7f55a-d8e5-41ae-8455-8ecde0733d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:03.978366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1149/2266] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:03 2022] DELETE /identity/v3/projects/7f3d631c19834afd85df668eb3aaf73b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:04.002054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b7c7f55a-d8e5-41ae-8455-8ecde0733d73 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:04.003331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b7c7f55a-d8e5-41ae-8455-8ecde0733d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:04.083377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1118/2267] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:04.085355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cedc-4de3-4541-9c4d-d79141b2221e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:04.085861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cedc-4de3-4541-9c4d-d79141b2221e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:04.086328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cedc-4de3-4541-9c4d-d79141b2221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:04.107239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6138cedc-4de3-4541-9c4d-d79141b2221e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:04.108760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6138cedc-4de3-4541-9c4d-d79141b2221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:04.117519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1150/2268] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:04.123706 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7f55a-d8e5-41ae-8455-8ecde0733d73 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:04.136356 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7f55a-d8e5-41ae-8455-8ecde0733d73 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:04.143984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c505a-db25-4d18-90a9-1ff99f549c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:04.145542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c505a-db25-4d18-90a9-1ff99f549c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:04.145906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c505a-db25-4d18-90a9-1ff99f549c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:04.146619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c505a-db25-4d18-90a9-1ff99f549c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:04.147529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c505a-db25-4d18-90a9-1ff99f549c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:25:04.147933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c505a-db25-4d18-90a9-1ff99f549c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:04.150962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c505a-db25-4d18-90a9-1ff99f549c72 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:04.172690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1119/2269] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:25:04.174163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138cedc-4de3-4541-9c4d-d79141b2221e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:04.184531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138cedc-4de3-4541-9c4d-d79141b2221e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:04.190122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9221ab6-79cb-4536-98f8-32151cbc4b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:04.190941 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9221ab6-79cb-4536-98f8-32151cbc4b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:04.191253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9221ab6-79cb-4536-98f8-32151cbc4b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:04.191529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9221ab6-79cb-4536-98f8-32151cbc4b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:04.192896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9221ab6-79cb-4536-98f8-32151cbc4b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:04.195160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9221ab6-79cb-4536-98f8-32151cbc4b73 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:04.267912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1151/2270] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:04 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:04.269453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c505a-db25-4d18-90a9-1ff99f549c72 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:04.284639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c505a-db25-4d18-90a9-1ff99f549c72 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:04.365152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0927522-1179-4acc-b481-3421cd674fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:04.365846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0927522-1179-4acc-b481-3421cd674fec admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:04.366139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0927522-1179-4acc-b481-3421cd674fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:04.366421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0927522-1179-4acc-b481-3421cd674fec admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:04.367125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0927522-1179-4acc-b481-3421cd674fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:04.369639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0927522-1179-4acc-b481-3421cd674fec admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:04.456730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1120/2271] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:04 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:25:04.461455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9221ab6-79cb-4536-98f8-32151cbc4b73 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:04.480589 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9221ab6-79cb-4536-98f8-32151cbc4b73 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:04.489563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee908596-e938-49ea-84eb-3bfecf46a222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:04.490248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee908596-e938-49ea-84eb-3bfecf46a222 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:04.490531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee908596-e938-49ea-84eb-3bfecf46a222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:04.490877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee908596-e938-49ea-84eb-3bfecf46a222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:04.491591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee908596-e938-49ea-84eb-3bfecf46a222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:04.493448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee908596-e938-49ea-84eb-3bfecf46a222 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:04.506757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1152/2272] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:25:04.510961 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0927522-1179-4acc-b481-3421cd674fec admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:04.522157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0927522-1179-4acc-b481-3421cd674fec admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:04.528044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851e7da-befa-4718-ad3a-e6446117b1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:04.528765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851e7da-befa-4718-ad3a-e6446117b1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:04.529090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851e7da-befa-4718-ad3a-e6446117b1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:04.529413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851e7da-befa-4718-ad3a-e6446117b1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:04.530104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851e7da-befa-4718-ad3a-e6446117b1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:04.531724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851e7da-befa-4718-ad3a-e6446117b1ef admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:04.544852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1121/2273] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:04.556609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee908596-e938-49ea-84eb-3bfecf46a222 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:04.568210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee908596-e938-49ea-84eb-3bfecf46a222 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:04.574633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb6255-7755-43bd-bd79-502885a48b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:04.575569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb6255-7755-43bd-bd79-502885a48b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:04.575856 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb6255-7755-43bd-bd79-502885a48b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:04.576137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb6255-7755-43bd-bd79-502885a48b79 admin admin] PATH_INFO: `/v3/projects/68261e6a24b44975880a0e88082819ee/users/3fb4b9d9100a416890e748168d8bafa1/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:04.595562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb6255-7755-43bd-bd79-502885a48b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68261e6a24b44975880a0e88082819ee, user_id=3fb4b9d9100a416890e748168d8bafa1, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:04.598300 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb6255-7755-43bd-bd79-502885a48b79 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:04.676841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1153/2274] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:04 2022] PUT /identity/v3/projects/68261e6a24b44975880a0e88082819ee/users/3fb4b9d9100a416890e748168d8bafa1/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:04.679079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa8b92-9cc7-4a18-90ca-ddcb0f8034c0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:04.679377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa8b92-9cc7-4a18-90ca-ddcb0f8034c0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:04.679654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa8b92-9cc7-4a18-90ca-ddcb0f8034c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:04.711419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0baa8b92-9cc7-4a18-90ca-ddcb0f8034c0 None None] MFA Rules not processed for user `3fb4b9d9100a416890e748168d8bafa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:04.712990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0baa8b92-9cc7-4a18-90ca-ddcb0f8034c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:04.767100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:04.803426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1122/2275] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:04.807813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb6255-7755-43bd-bd79-502885a48b79 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:04.891284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb6255-7755-43bd-bd79-502885a48b79 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:04.896184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4182b-386d-4cdd-ae67-51da052f7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:04.896896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4182b-386d-4cdd-ae67-51da052f7308 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:04.897181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4182b-386d-4cdd-ae67-51da052f7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:04.897459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4182b-386d-4cdd-ae67-51da052f7308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:04.898442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4182b-386d-4cdd-ae67-51da052f7308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:04.900379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4182b-386d-4cdd-ae67-51da052f7308 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:04.915134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:05.011546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1154/2276] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:04 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:05.016802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa8b92-9cc7-4a18-90ca-ddcb0f8034c0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:05.035971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa8b92-9cc7-4a18-90ca-ddcb0f8034c0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:05.139582 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabcc70-4dec-403b-b9f3-f091174337b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:05.140466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabcc70-4dec-403b-b9f3-f091174337b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:05.140849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabcc70-4dec-403b-b9f3-f091174337b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:05.141227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabcc70-4dec-403b-b9f3-f091174337b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:05.142110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabcc70-4dec-403b-b9f3-f091174337b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:05.144207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabcc70-4dec-403b-b9f3-f091174337b5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:05.224349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1123/2277] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:05 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:05.226906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4182b-386d-4cdd-ae67-51da052f7308 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:05.237401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4182b-386d-4cdd-ae67-51da052f7308 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:05.243259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95d92b-b6c7-41e2-87e4-20f9fbd72086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:05.243936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95d92b-b6c7-41e2-87e4-20f9fbd72086 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:05.244228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95d92b-b6c7-41e2-87e4-20f9fbd72086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:05.244538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95d92b-b6c7-41e2-87e4-20f9fbd72086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:05.245844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95d92b-b6c7-41e2-87e4-20f9fbd72086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:05.247498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95d92b-b6c7-41e2-87e4-20f9fbd72086 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:05.260365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1155/2278] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:05.264289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabcc70-4dec-403b-b9f3-f091174337b5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:05.276009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabcc70-4dec-403b-b9f3-f091174337b5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:05.292875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9878-4d0c-473e-bb2d-6f469097f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:05.297478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9878-4d0c-473e-bb2d-6f469097f16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:05.297478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9878-4d0c-473e-bb2d-6f469097f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:05.297478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9878-4d0c-473e-bb2d-6f469097f16d admin admin] PATH_INFO: `/v3/projects/6eabde9548654931848b95002d3977ac/users/728a564642b74d39aa1d41229412e39b/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:05.314959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9878-4d0c-473e-bb2d-6f469097f16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eabde9548654931848b95002d3977ac, user_id=728a564642b74d39aa1d41229412e39b, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:05.318008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9878-4d0c-473e-bb2d-6f469097f16d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:05.435026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1124/2279] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:05 2022] PUT /identity/v3/projects/6eabde9548654931848b95002d3977ac/users/728a564642b74d39aa1d41229412e39b/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:05.439289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95d92b-b6c7-41e2-87e4-20f9fbd72086 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:05.449360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95d92b-b6c7-41e2-87e4-20f9fbd72086 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:05.526595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8c54f-9b4b-4eff-a033-027312391f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:05.527280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c54f-9b4b-4eff-a033-027312391f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:05.527570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c54f-9b4b-4eff-a033-027312391f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:05.527853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c54f-9b4b-4eff-a033-027312391f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:05.528614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8c54f-9b4b-4eff-a033-027312391f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:05.533502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8c54f-9b4b-4eff-a033-027312391f5d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:05.560441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1156/2280] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:05.564901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9878-4d0c-473e-bb2d-6f469097f16d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:05.585563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9878-4d0c-473e-bb2d-6f469097f16d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:05.601135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0265b7-c897-48d8-b6e6-35f6ad98ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:05.602577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0265b7-c897-48d8-b6e6-35f6ad98ab18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:05.602872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0265b7-c897-48d8-b6e6-35f6ad98ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:05.603156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0265b7-c897-48d8-b6e6-35f6ad98ab18 admin admin] PATH_INFO: `/v3/projects/6eabde9548654931848b95002d3977ac/users/728a564642b74d39aa1d41229412e39b/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:05.606193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0265b7-c897-48d8-b6e6-35f6ad98ab18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eabde9548654931848b95002d3977ac, user_id=728a564642b74d39aa1d41229412e39b, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:05.608626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0265b7-c897-48d8-b6e6-35f6ad98ab18 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:05.622898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1125/2281] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:05 2022] PUT /identity/v3/projects/6eabde9548654931848b95002d3977ac/users/728a564642b74d39aa1d41229412e39b/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:05.633736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc761b-8ee6-4f82-9b09-cb5442c25a6c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:05.634032 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc761b-8ee6-4f82-9b09-cb5442c25a6c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:05.634313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc761b-8ee6-4f82-9b09-cb5442c25a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:05.668776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d1dc761b-8ee6-4f82-9b09-cb5442c25a6c None None] MFA Rules not processed for user `728a564642b74d39aa1d41229412e39b`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:05.670101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d1dc761b-8ee6-4f82-9b09-cb5442c25a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:05.769957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1157/2282] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:05.790492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0265b7-c897-48d8-b6e6-35f6ad98ab18 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:05.793254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-be0265b7-c897-48d8-b6e6-35f6ad98ab18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:05.915579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0265b7-c897-48d8-b6e6-35f6ad98ab18 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:05.922256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430fd22-1537-4eea-9c94-90872e1e4291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:05.923345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430fd22-1537-4eea-9c94-90872e1e4291 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:05.923839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430fd22-1537-4eea-9c94-90872e1e4291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:05.924196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430fd22-1537-4eea-9c94-90872e1e4291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:05.964195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:05.993091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430fd22-1537-4eea-9c94-90872e1e4291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:05.994609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430fd22-1537-4eea-9c94-90872e1e4291 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:06.005992 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1126/2283] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:09.433780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc761b-8ee6-4f82-9b09-cb5442c25a6c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:09.546961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc761b-8ee6-4f82-9b09-cb5442c25a6c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:09.556036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:09.556970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:09.557802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:09.558151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] PATH_INFO: `/v3/users/3fb4b9d9100a416890e748168d8bafa1` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:09.559433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb4b9d9100a416890e748168d8bafa1)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:09.561454 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:09.569727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:09.759528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb4b9d9100a416890e748168d8bafa1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:09.762099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb4b9d9100a416890e748168d8bafa1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:09.771537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb4b9d9100a416890e748168d8bafa1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:09.772250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb4b9d9100a416890e748168d8bafa1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:09.809467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb4b9d9100a416890e748168d8bafa1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:09.879266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1158/2284] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:09 2022] DELETE /identity/v3/users/3fb4b9d9100a416890e748168d8bafa1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:09.884131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf3c7d-977e-474c-8b3c-b72d164bebe0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:09.885250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf3c7d-977e-474c-8b3c-b72d164bebe0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:09.885555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf3c7d-977e-474c-8b3c-b72d164bebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:09.904208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4acf3c7d-977e-474c-8b3c-b72d164bebe0 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:09.905601 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4acf3c7d-977e-474c-8b3c-b72d164bebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:09.978061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1127/2285] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:09.990699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:09.992275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:10.079942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055a17f-9884-4ba9-93c3-366ce86b4480 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:10.086383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7aec9-ffb2-4b93-b7c0-7b599d5ed9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:10.087162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7aec9-ffb2-4b93-b7c0-7b599d5ed9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:10.087543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7aec9-ffb2-4b93-b7c0-7b599d5ed9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:10.087944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7aec9-ffb2-4b93-b7c0-7b599d5ed9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:10.100240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7aec9-ffb2-4b93-b7c0-7b599d5ed9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:10.102020 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7aec9-ffb2-4b93-b7c0-7b599d5ed9dc service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:10.117341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1159/2286] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:11.095717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf3c7d-977e-474c-8b3c-b72d164bebe0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:11.097267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4acf3c7d-977e-474c-8b3c-b72d164bebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:11.121398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf3c7d-977e-474c-8b3c-b72d164bebe0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:11.143530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:11.145070 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:11.145362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:11.145641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] PATH_INFO: `/v3/projects/68261e6a24b44975880a0e88082819ee` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:11.146856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68261e6a24b44975880a0e88082819ee)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:11.148877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:11.301697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68261e6a24b44975880a0e88082819ee', 'request_id': 'req-6685dc2e-c2f4-4028-9444-98d48f97c28f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.383563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68261e6a24b44975880a0e88082819ee', 'request_id': 'req-6685dc2e-c2f4-4028-9444-98d48f97c28f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.394724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68261e6a24b44975880a0e88082819ee', 'request_id': 'req-6685dc2e-c2f4-4028-9444-98d48f97c28f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.414264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] The token cache is being invalidate because project 68261e6a24b44975880a0e88082819ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:11.414758 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.415495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.420713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1128/2287] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:11 2022] DELETE /identity/v3/projects/68261e6a24b44975880a0e88082819ee => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:11.422048 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7aec9-ffb2-4b93-b7c0-7b599d5ed9dc service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:11.436991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7aec9-ffb2-4b93-b7c0-7b599d5ed9dc service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:11.519286 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:11.520597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:11.520908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:11.521165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] PATH_INFO: `/v3/users/728a564642b74d39aa1d41229412e39b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:11.522374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728a564642b74d39aa1d41229412e39b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:11.524783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:11.653718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:11.805649 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728a564642b74d39aa1d41229412e39b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.806974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728a564642b74d39aa1d41229412e39b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.829549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728a564642b74d39aa1d41229412e39b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.830373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728a564642b74d39aa1d41229412e39b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.868956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7fedc52f-dafe-4418-8bff-8490bbf40a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728a564642b74d39aa1d41229412e39b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:11.993268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1160/2288] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:11 2022] DELETE /identity/v3/users/728a564642b74d39aa1d41229412e39b => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:12.477659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:12.480443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:12.522244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685dc2e-c2f4-4028-9444-98d48f97c28f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:12.587957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:12.601346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:12.601346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:12.601346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:12.601797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] PATH_INFO: `/v3/projects/6eabde9548654931848b95002d3977ac` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:12.603006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eabde9548654931848b95002d3977ac)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:12.605873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:12.714363 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eabde9548654931848b95002d3977ac', 'request_id': 'req-7fa9b570-2124-4b04-8ae4-afdd866db9b6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:12.770918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eabde9548654931848b95002d3977ac', 'request_id': 'req-7fa9b570-2124-4b04-8ae4-afdd866db9b6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:12.779197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eabde9548654931848b95002d3977ac', 'request_id': 'req-7fa9b570-2124-4b04-8ae4-afdd866db9b6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:12.795208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] The token cache is being invalidate because project 6eabde9548654931848b95002d3977ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:12.803570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:12.803570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7fa9b570-2124-4b04-8ae4-afdd866db9b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:12.803570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1129/2289] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:12 2022] DELETE /identity/v3/projects/6eabde9548654931848b95002d3977ac => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:12.806036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32940d-bb9f-4f86-91b6-e4dca92b14cb None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:12.806546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32940d-bb9f-4f86-91b6-e4dca92b14cb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:12.806792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32940d-bb9f-4f86-91b6-e4dca92b14cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:12.835526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1f32940d-bb9f-4f86-91b6-e4dca92b14cb None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:12.835526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1f32940d-bb9f-4f86-91b6-e4dca92b14cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:12.920449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1161/2290] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:12.928116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4953-b12f-4854-8512-5c6cf10411ae None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:12.928447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4953-b12f-4854-8512-5c6cf10411ae None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:12.928733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4953-b12f-4854-8512-5c6cf10411ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:12.947448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-da4f4953-b12f-4854-8512-5c6cf10411ae None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:12.949186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-da4f4953-b12f-4854-8512-5c6cf10411ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:12.962391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1130/2291] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:12.967295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32940d-bb9f-4f86-91b6-e4dca92b14cb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:12.977245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32940d-bb9f-4f86-91b6-e4dca92b14cb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:12.981987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c3c0d-d8c6-49a0-8259-cbc5b02edbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:12.982637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3c0d-d8c6-49a0-8259-cbc5b02edbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:12.982944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3c0d-d8c6-49a0-8259-cbc5b02edbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:12.983217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3c0d-d8c6-49a0-8259-cbc5b02edbe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:12.983933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c3c0d-d8c6-49a0-8259-cbc5b02edbe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:25:12.984233 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c3c0d-d8c6-49a0-8259-cbc5b02edbe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:12.985855 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c3c0d-d8c6-49a0-8259-cbc5b02edbe5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:13.001219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1162/2292] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:25:13.002898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4953-b12f-4854-8512-5c6cf10411ae None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:13.015659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4953-b12f-4854-8512-5c6cf10411ae None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:13.021184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525e71-a07a-48d3-a6bd-aee8fedcbebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:13.021886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525e71-a07a-48d3-a6bd-aee8fedcbebe admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:13.022220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525e71-a07a-48d3-a6bd-aee8fedcbebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:13.022497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525e71-a07a-48d3-a6bd-aee8fedcbebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:13.023201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525e71-a07a-48d3-a6bd-aee8fedcbebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:13.025215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525e71-a07a-48d3-a6bd-aee8fedcbebe admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:13.141809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1131/2293] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:13 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:13.144631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c3c0d-d8c6-49a0-8259-cbc5b02edbe5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:13.162541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c3c0d-d8c6-49a0-8259-cbc5b02edbe5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:13.238063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ae05a-b82d-42a9-bdaa-ddf88e32c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:13.238822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ae05a-b82d-42a9-bdaa-ddf88e32c88c admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:13.239108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ae05a-b82d-42a9-bdaa-ddf88e32c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:13.239382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ae05a-b82d-42a9-bdaa-ddf88e32c88c admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:13.241120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ae05a-b82d-42a9-bdaa-ddf88e32c88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:13.243088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ae05a-b82d-42a9-bdaa-ddf88e32c88c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:13.355069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1163/2294] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:13 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:13.359068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525e71-a07a-48d3-a6bd-aee8fedcbebe admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:13.369206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525e71-a07a-48d3-a6bd-aee8fedcbebe admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:13.374432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a1c18-837a-4416-b1be-5b5d69ca9e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:13.383836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a1c18-837a-4416-b1be-5b5d69ca9e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:13.383836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a1c18-837a-4416-b1be-5b5d69ca9e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:13.383836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a1c18-837a-4416-b1be-5b5d69ca9e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:13.383836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a1c18-837a-4416-b1be-5b5d69ca9e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:13.383836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a1c18-837a-4416-b1be-5b5d69ca9e3b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:13.389846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1132/2295] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:13.393896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ae05a-b82d-42a9-bdaa-ddf88e32c88c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:13.404083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ae05a-b82d-42a9-bdaa-ddf88e32c88c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:13.408806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715a30b-2cf7-4f69-b684-dd6b0c8e9d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:13.409609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a30b-2cf7-4f69-b684-dd6b0c8e9d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:13.409900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a30b-2cf7-4f69-b684-dd6b0c8e9d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:13.410181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a30b-2cf7-4f69-b684-dd6b0c8e9d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:13.410928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715a30b-2cf7-4f69-b684-dd6b0c8e9d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:13.412645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715a30b-2cf7-4f69-b684-dd6b0c8e9d33 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:13.422564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1164/2296] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:13.427686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a1c18-837a-4416-b1be-5b5d69ca9e3b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:13.437027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a1c18-837a-4416-b1be-5b5d69ca9e3b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:13.441775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd7c8e-fb4e-4a72-bcef-332e2cb510b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:13.442641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd7c8e-fb4e-4a72-bcef-332e2cb510b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:13.442921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd7c8e-fb4e-4a72-bcef-332e2cb510b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:13.443194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd7c8e-fb4e-4a72-bcef-332e2cb510b4 admin admin] PATH_INFO: `/v3/projects/1b2087a6a3f54b5b9a31d7b9705bd04b/users/54b80bb6c8254c4098ec8c34da5c8b84/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:13.458297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd7c8e-fb4e-4a72-bcef-332e2cb510b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2087a6a3f54b5b9a31d7b9705bd04b, user_id=54b80bb6c8254c4098ec8c34da5c8b84, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:13.461058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd7c8e-fb4e-4a72-bcef-332e2cb510b4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:13.524787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1133/2297] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:13 2022] PUT /identity/v3/projects/1b2087a6a3f54b5b9a31d7b9705bd04b/users/54b80bb6c8254c4098ec8c34da5c8b84/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:13.535044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7396e-e593-43ea-9b39-cc542c2303fa None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:13.535358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7396e-e593-43ea-9b39-cc542c2303fa None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:13.535622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7396e-e593-43ea-9b39-cc542c2303fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:13.554979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:13.562928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b1b7396e-e593-43ea-9b39-cc542c2303fa None None] MFA Rules not processed for user `54b80bb6c8254c4098ec8c34da5c8b84`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:13.564119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b1b7396e-e593-43ea-9b39-cc542c2303fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:13.627151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1165/2298] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:13.631508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd7c8e-fb4e-4a72-bcef-332e2cb510b4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:13.693726 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd7c8e-fb4e-4a72-bcef-332e2cb510b4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:13.698527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca356f4-6fdf-4f19-8699-0de4f497340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:13.699178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca356f4-6fdf-4f19-8699-0de4f497340e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:13.699462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca356f4-6fdf-4f19-8699-0de4f497340e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:13.699737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca356f4-6fdf-4f19-8699-0de4f497340e admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:13.700464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca356f4-6fdf-4f19-8699-0de4f497340e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:13.702442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca356f4-6fdf-4f19-8699-0de4f497340e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:13.813564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1134/2299] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:13 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:25:13.817436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7396e-e593-43ea-9b39-cc542c2303fa None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:13.829436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7396e-e593-43ea-9b39-cc542c2303fa None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:13.886698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe199377-8dc6-4bc9-8ac6-83c0c053a049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:13.887374 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe199377-8dc6-4bc9-8ac6-83c0c053a049 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:13.887654 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe199377-8dc6-4bc9-8ac6-83c0c053a049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:13.887928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe199377-8dc6-4bc9-8ac6-83c0c053a049 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:13.888769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe199377-8dc6-4bc9-8ac6-83c0c053a049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:13.891372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe199377-8dc6-4bc9-8ac6-83c0c053a049 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:13.967276 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48323b-7b34-4964-b56e-74b181600d94 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:13.967574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48323b-7b34-4964-b56e-74b181600d94 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:13.967860 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48323b-7b34-4964-b56e-74b181600d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:13.975082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:13.986491 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5f48323b-7b34-4964-b56e-74b181600d94 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:13.987691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f48323b-7b34-4964-b56e-74b181600d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:14.011685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1166/2300] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:13 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:14.015499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe199377-8dc6-4bc9-8ac6-83c0c053a049 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.025128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe199377-8dc6-4bc9-8ac6-83c0c053a049 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.030576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ba057-a8b1-4fca-b914-43ad0162610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.031255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ba057-a8b1-4fca-b914-43ad0162610f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.031592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ba057-a8b1-4fca-b914-43ad0162610f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.031871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ba057-a8b1-4fca-b914-43ad0162610f admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.032633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ba057-a8b1-4fca-b914-43ad0162610f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.034357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ba057-a8b1-4fca-b914-43ad0162610f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.044730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1135/2301] 10.222.0.15 () {58 vars in 967 bytes} [Thu May 26 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:25:14.049753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1167/2302] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:25:14.049907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48323b-7b34-4964-b56e-74b181600d94 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.058825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ba057-a8b1-4fca-b914-43ad0162610f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.060059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48323b-7b34-4964-b56e-74b181600d94 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.060573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4f1ba057-a8b1-4fca-b914-43ad0162610f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:14.065039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c4bfb-6819-4455-98f7-b95e1656ccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.065701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c4bfb-6819-4455-98f7-b95e1656ccbe admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.065985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c4bfb-6819-4455-98f7-b95e1656ccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.066259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c4bfb-6819-4455-98f7-b95e1656ccbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.067046 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c4bfb-6819-4455-98f7-b95e1656ccbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.068683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c4bfb-6819-4455-98f7-b95e1656ccbe admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.080204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1136/2303] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:25:14.083332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c4bfb-6819-4455-98f7-b95e1656ccbe admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.093417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c4bfb-6819-4455-98f7-b95e1656ccbe admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.098299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5583f0-21dd-4cfa-b7e4-e3063abbed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.099153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5583f0-21dd-4cfa-b7e4-e3063abbed7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.099434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5583f0-21dd-4cfa-b7e4-e3063abbed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.099708 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5583f0-21dd-4cfa-b7e4-e3063abbed7e admin admin] PATH_INFO: `/v3/projects/39fa182e1026486b9bf1c7cada05eb51/users/12aaf2a43f6944d689a25de6e17d5c85/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.115072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5583f0-21dd-4cfa-b7e4-e3063abbed7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fa182e1026486b9bf1c7cada05eb51, user_id=12aaf2a43f6944d689a25de6e17d5c85, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.117749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5583f0-21dd-4cfa-b7e4-e3063abbed7e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.130925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ba057-a8b1-4fca-b914-43ad0162610f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.136622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557972d9-2872-4fda-99a7-ed8713497eb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.137280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557972d9-2872-4fda-99a7-ed8713497eb7 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.137562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557972d9-2872-4fda-99a7-ed8713497eb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.137837 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557972d9-2872-4fda-99a7-ed8713497eb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.146003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557972d9-2872-4fda-99a7-ed8713497eb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.147696 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557972d9-2872-4fda-99a7-ed8713497eb7 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.156178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1168/2304] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:25:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 03:25:14.205099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1137/2305] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:14 2022] PUT /identity/v3/projects/39fa182e1026486b9bf1c7cada05eb51/users/12aaf2a43f6944d689a25de6e17d5c85/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:25:14.216810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136dfe6-02bc-4a4b-9835-278a468b7a63 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.217104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136dfe6-02bc-4a4b-9835-278a468b7a63 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.217388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136dfe6-02bc-4a4b-9835-278a468b7a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.236204 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:14.244527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6136dfe6-02bc-4a4b-9835-278a468b7a63 None None] MFA Rules not processed for user `12aaf2a43f6944d689a25de6e17d5c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:14.245720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6136dfe6-02bc-4a4b-9835-278a468b7a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:14.308915 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1169/2306] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:14.313525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5583f0-21dd-4cfa-b7e4-e3063abbed7e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.379237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5583f0-21dd-4cfa-b7e4-e3063abbed7e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.383994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798850c-8bb6-41bd-be53-92e685d92935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.384744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798850c-8bb6-41bd-be53-92e685d92935 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.385031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798850c-8bb6-41bd-be53-92e685d92935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.385311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798850c-8bb6-41bd-be53-92e685d92935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.386151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798850c-8bb6-41bd-be53-92e685d92935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.389102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798850c-8bb6-41bd-be53-92e685d92935 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.481172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1138/2307] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:14 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:14.485202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136dfe6-02bc-4a4b-9835-278a468b7a63 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.497171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136dfe6-02bc-4a4b-9835-278a468b7a63 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.562203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c6c96-b3f4-4f8d-a060-9c76f05fb137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.563224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c6c96-b3f4-4f8d-a060-9c76f05fb137 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.563534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c6c96-b3f4-4f8d-a060-9c76f05fb137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.563808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c6c96-b3f4-4f8d-a060-9c76f05fb137 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.564544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c6c96-b3f4-4f8d-a060-9c76f05fb137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.566543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c6c96-b3f4-4f8d-a060-9c76f05fb137 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.662687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1170/2308] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:14 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:14.666499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798850c-8bb6-41bd-be53-92e685d92935 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.676854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798850c-8bb6-41bd-be53-92e685d92935 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.681614 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435a75e-8703-44a0-ad5d-51230af82a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.684397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435a75e-8703-44a0-ad5d-51230af82a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.684397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435a75e-8703-44a0-ad5d-51230af82a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.684397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435a75e-8703-44a0-ad5d-51230af82a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.684397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435a75e-8703-44a0-ad5d-51230af82a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.685812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435a75e-8703-44a0-ad5d-51230af82a67 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.696692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1139/2309] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:14.701567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c6c96-b3f4-4f8d-a060-9c76f05fb137 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.711495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c6c96-b3f4-4f8d-a060-9c76f05fb137 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.716442 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9c12c-6e46-4480-9843-0d4aaa93f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.717323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c12c-6e46-4480-9843-0d4aaa93f268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.717598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c12c-6e46-4480-9843-0d4aaa93f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.717871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c12c-6e46-4480-9843-0d4aaa93f268 admin admin] PATH_INFO: `/v3/projects/ac6d9fa23aed4f30917d1babaeff0e6d/users/68f8e60e538a47d2901676cf12f0633f/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.732535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9c12c-6e46-4480-9843-0d4aaa93f268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6d9fa23aed4f30917d1babaeff0e6d, user_id=68f8e60e538a47d2901676cf12f0633f, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.735191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9c12c-6e46-4480-9843-0d4aaa93f268 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.794299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1171/2310] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:14 2022] PUT /identity/v3/projects/ac6d9fa23aed4f30917d1babaeff0e6d/users/68f8e60e538a47d2901676cf12f0633f/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:14.798285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435a75e-8703-44a0-ad5d-51230af82a67 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.808374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435a75e-8703-44a0-ad5d-51230af82a67 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.857082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:14.868983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e502913-af21-4b22-86a9-f0b4302bd2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.869727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e502913-af21-4b22-86a9-f0b4302bd2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.869931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e502913-af21-4b22-86a9-f0b4302bd2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.870211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e502913-af21-4b22-86a9-f0b4302bd2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.870985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e502913-af21-4b22-86a9-f0b4302bd2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.873125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e502913-af21-4b22-86a9-f0b4302bd2b1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.885585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1140/2311] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:14.889266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9c12c-6e46-4480-9843-0d4aaa93f268 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:14.900336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9c12c-6e46-4480-9843-0d4aaa93f268 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:14.905351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93662cd-21d4-49d7-9ad9-faadc0f0a577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:14.907424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93662cd-21d4-49d7-9ad9-faadc0f0a577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.907424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93662cd-21d4-49d7-9ad9-faadc0f0a577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.907424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93662cd-21d4-49d7-9ad9-faadc0f0a577 admin admin] PATH_INFO: `/v3/projects/ac6d9fa23aed4f30917d1babaeff0e6d/users/68f8e60e538a47d2901676cf12f0633f/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.908902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93662cd-21d4-49d7-9ad9-faadc0f0a577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6d9fa23aed4f30917d1babaeff0e6d, user_id=68f8e60e538a47d2901676cf12f0633f, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:14.911598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93662cd-21d4-49d7-9ad9-faadc0f0a577 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:14.923051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1172/2312] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:14 2022] PUT /identity/v3/projects/ac6d9fa23aed4f30917d1babaeff0e6d/users/68f8e60e538a47d2901676cf12f0633f/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:14.933158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63739-fd10-4538-ba28-ea6f6c626812 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:14.933485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63739-fd10-4538-ba28-ea6f6c626812 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:14.934835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63739-fd10-4538-ba28-ea6f6c626812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:14.969464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-99f63739-fd10-4538-ba28-ea6f6c626812 None None] MFA Rules not processed for user `68f8e60e538a47d2901676cf12f0633f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:14.970802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-99f63739-fd10-4538-ba28-ea6f6c626812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:15.044200 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1141/2313] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:15.055499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93662cd-21d4-49d7-9ad9-faadc0f0a577 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:15.057219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c93662cd-21d4-49d7-9ad9-faadc0f0a577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:15.122400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93662cd-21d4-49d7-9ad9-faadc0f0a577 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:15.126197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d5947-69e3-4112-9bf4-8203cc59a7e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:15.126854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d5947-69e3-4112-9bf4-8203cc59a7e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:15.127158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d5947-69e3-4112-9bf4-8203cc59a7e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:15.127416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d5947-69e3-4112-9bf4-8203cc59a7e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:15.131842 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:15.185392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d5947-69e3-4112-9bf4-8203cc59a7e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:15.186772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d5947-69e3-4112-9bf4-8203cc59a7e5 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:15.199428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1173/2314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:17.271377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63739-fd10-4538-ba28-ea6f6c626812 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:17.298745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63739-fd10-4538-ba28-ea6f6c626812 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:17.304802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b66069-ae72-4690-9b33-61c6c0f6e32f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:17.305583 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b66069-ae72-4690-9b33-61c6c0f6e32f service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:17.305964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b66069-ae72-4690-9b33-61c6c0f6e32f service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:17.306308 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b66069-ae72-4690-9b33-61c6c0f6e32f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:17.411238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b66069-ae72-4690-9b33-61c6c0f6e32f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:17.413097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b66069-ae72-4690-9b33-61c6c0f6e32f service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:17.423983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1142/2315] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:17.511090 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d5947-69e3-4112-9bf4-8203cc59a7e5 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:17.514200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cc6d5947-69e3-4112-9bf4-8203cc59a7e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:17.629625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d5947-69e3-4112-9bf4-8203cc59a7e5 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:17.637596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:17.641337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:17.641337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:17.641337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] PATH_INFO: `/v3/users/0413e7978b554cfba4902761836b8895` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:17.641337 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0413e7978b554cfba4902761836b8895)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:17.643397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:17.850057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0413e7978b554cfba4902761836b8895'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:17.851066 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0413e7978b554cfba4902761836b8895'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:17.858173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0413e7978b554cfba4902761836b8895'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:17.858803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0413e7978b554cfba4902761836b8895'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:17.870947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-c78a1667-5680-40dd-ae8f-a8e9e2540d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0413e7978b554cfba4902761836b8895'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:17.959329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1174/2316] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:17 2022] DELETE /identity/v3/users/0413e7978b554cfba4902761836b8895 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:18.212074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b66069-ae72-4690-9b33-61c6c0f6e32f service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:18.231325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b66069-ae72-4690-9b33-61c6c0f6e32f service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:18.318088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:18.319625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:18.319913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:18.320435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] PATH_INFO: `/v3/projects/cc88fea17ecd4b41a7183eae53162ba5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:18.321781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc88fea17ecd4b41a7183eae53162ba5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:18.323872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:18.336958 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:18.457646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc88fea17ecd4b41a7183eae53162ba5', 'request_id': 'req-f2162855-b125-476b-b31f-5ddb7c9b1446'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:18.513416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc88fea17ecd4b41a7183eae53162ba5', 'request_id': 'req-f2162855-b125-476b-b31f-5ddb7c9b1446'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:18.520610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc88fea17ecd4b41a7183eae53162ba5', 'request_id': 'req-f2162855-b125-476b-b31f-5ddb7c9b1446'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:18.531161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] The token cache is being invalidate because project cc88fea17ecd4b41a7183eae53162ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:18.531447 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:18.532080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f2162855-b125-476b-b31f-5ddb7c9b1446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:18.533766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1143/2317] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:18 2022] DELETE /identity/v3/projects/cc88fea17ecd4b41a7183eae53162ba5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:18.538587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d76b0-3163-4584-ac50-a89174a89516 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:18.539052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d76b0-3163-4584-ac50-a89174a89516 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:18.539145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d76b0-3163-4584-ac50-a89174a89516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:18.556918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-405d76b0-3163-4584-ac50-a89174a89516 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:18.558102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-405d76b0-3163-4584-ac50-a89174a89516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:18.579487 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:18.618428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1175/2318] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:18.626506 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa7ea-3b7b-4313-95bf-d937228cf88d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:18.626794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa7ea-3b7b-4313-95bf-d937228cf88d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:18.627072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa7ea-3b7b-4313-95bf-d937228cf88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:18.645824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-93efa7ea-3b7b-4313-95bf-d937228cf88d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:18.647042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-93efa7ea-3b7b-4313-95bf-d937228cf88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:18.658722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1144/2319] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:18.659774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d76b0-3163-4584-ac50-a89174a89516 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:18.669376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d76b0-3163-4584-ac50-a89174a89516 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:18.673906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ecbb1-b3a6-4dc1-b0e0-66900b197e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:18.674560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ecbb1-b3a6-4dc1-b0e0-66900b197e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:18.674844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ecbb1-b3a6-4dc1-b0e0-66900b197e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:18.675120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ecbb1-b3a6-4dc1-b0e0-66900b197e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:18.675842 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ecbb1-b3a6-4dc1-b0e0-66900b197e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:25:18.676152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ecbb1-b3a6-4dc1-b0e0-66900b197e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:18.677778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ecbb1-b3a6-4dc1-b0e0-66900b197e10 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:18.690431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1176/2320] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:25:18.694593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa7ea-3b7b-4313-95bf-d937228cf88d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:18.704671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa7ea-3b7b-4313-95bf-d937228cf88d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:18.709321 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b2e4b-ea60-4165-bfb3-bd4cba2f3f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:18.709911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b2e4b-ea60-4165-bfb3-bd4cba2f3f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:18.710195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b2e4b-ea60-4165-bfb3-bd4cba2f3f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:18.710475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b2e4b-ea60-4165-bfb3-bd4cba2f3f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:18.711183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b2e4b-ea60-4165-bfb3-bd4cba2f3f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:18.713125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b2e4b-ea60-4165-bfb3-bd4cba2f3f34 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:18.802960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1145/2321] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:18 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:18.806631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ecbb1-b3a6-4dc1-b0e0-66900b197e10 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:18.817659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ecbb1-b3a6-4dc1-b0e0-66900b197e10 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:18.879612 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cccad-c805-4c87-885d-3d5d1149a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:18.880581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cccad-c805-4c87-885d-3d5d1149a503 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:18.880865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cccad-c805-4c87-885d-3d5d1149a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:18.881143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cccad-c805-4c87-885d-3d5d1149a503 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:18.881832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cccad-c805-4c87-885d-3d5d1149a503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:18.883782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cccad-c805-4c87-885d-3d5d1149a503 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:18.904138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b2e4b-ea60-4165-bfb3-bd4cba2f3f34 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:18.906103 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-717b2e4b-ea60-4165-bfb3-bd4cba2f3f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:18.962462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b2e4b-ea60-4165-bfb3-bd4cba2f3f34 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:18.966257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955e659-37ba-4ed3-92f9-185143d88e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:18.966909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955e659-37ba-4ed3-92f9-185143d88e16 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:18.967201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955e659-37ba-4ed3-92f9-185143d88e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:18.967479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955e659-37ba-4ed3-92f9-185143d88e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:18.969335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2955e659-37ba-4ed3-92f9-185143d88e16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:18.972617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1177/2322] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:18 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:18.976659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cccad-c805-4c87-885d-3d5d1149a503 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:18.988042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cccad-c805-4c87-885d-3d5d1149a503 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:18.993125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ebf8a-37f9-4281-a8b0-4c9a69a4ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:18.993866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ebf8a-37f9-4281-a8b0-4c9a69a4ab12 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:18.994214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ebf8a-37f9-4281-a8b0-4c9a69a4ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:18.994556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ebf8a-37f9-4281-a8b0-4c9a69a4ab12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:18.995340 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ebf8a-37f9-4281-a8b0-4c9a69a4ab12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:18.997624 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ebf8a-37f9-4281-a8b0-4c9a69a4ab12 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:19.007743 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1178/2323] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:25:19.011646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ebf8a-37f9-4281-a8b0-4c9a69a4ab12 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:19.021616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ebf8a-37f9-4281-a8b0-4c9a69a4ab12 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:19.026778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3969-7da3-4dfb-955c-d320e9ac4b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:19.027605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3969-7da3-4dfb-955c-d320e9ac4b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:19.027790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3969-7da3-4dfb-955c-d320e9ac4b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:19.028070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3969-7da3-4dfb-955c-d320e9ac4b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:19.028811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c3969-7da3-4dfb-955c-d320e9ac4b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:19.030444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c3969-7da3-4dfb-955c-d320e9ac4b4e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:19.036684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955e659-37ba-4ed3-92f9-185143d88e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:19.038573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955e659-37ba-4ed3-92f9-185143d88e16 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:19.042174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1179/2324] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:25:19.049665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3969-7da3-4dfb-955c-d320e9ac4b4e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:19.052463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1146/2325] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:25:19.056984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3969-7da3-4dfb-955c-d320e9ac4b4e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:19.063142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9f12-f58b-43eb-ba07-16fc53de2396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:19.064037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9f12-f58b-43eb-ba07-16fc53de2396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:19.064335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9f12-f58b-43eb-ba07-16fc53de2396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:19.064623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9f12-f58b-43eb-ba07-16fc53de2396 admin admin] PATH_INFO: `/v3/projects/e10a67ff7d3c4325a2d9c210a3e03d31/users/a6a15afdf78848b298acbf1598dc90d6/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:19.083336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d9f12-f58b-43eb-ba07-16fc53de2396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10a67ff7d3c4325a2d9c210a3e03d31, user_id=a6a15afdf78848b298acbf1598dc90d6, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:19.086106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d9f12-f58b-43eb-ba07-16fc53de2396 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:19.205906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1180/2326] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:19 2022] PUT /identity/v3/projects/e10a67ff7d3c4325a2d9c210a3e03d31/users/a6a15afdf78848b298acbf1598dc90d6/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:25:19.219595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68e65-d11b-4fbb-8fad-72058d3bbe94 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:19.220001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68e65-d11b-4fbb-8fad-72058d3bbe94 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:19.220293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68e65-d11b-4fbb-8fad-72058d3bbe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:19.247436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f6d68e65-d11b-4fbb-8fad-72058d3bbe94 None None] MFA Rules not processed for user `a6a15afdf78848b298acbf1598dc90d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:19.248695 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f6d68e65-d11b-4fbb-8fad-72058d3bbe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:19.257587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:19.331852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1147/2327] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:19.345429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9f12-f58b-43eb-ba07-16fc53de2396 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:19.347290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e37d9f12-f58b-43eb-ba07-16fc53de2396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:19.409579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:19.431818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9f12-f58b-43eb-ba07-16fc53de2396 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:19.436163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387629d-6c34-4697-9817-1ded67180384 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b95fdb06a94c1586148df32413085f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:19.436850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387629d-6c34-4697-9817-1ded67180384 service glance] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:19.437141 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387629d-6c34-4697-9817-1ded67180384 service glance] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:19.437420 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387629d-6c34-4697-9817-1ded67180384 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:19.452647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387629d-6c34-4697-9817-1ded67180384 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:19.452647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387629d-6c34-4697-9817-1ded67180384 service glance] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:19.458824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1181/2328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:19.838371 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49be177-2bef-45cb-ba94-d162885b8808 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:19.838911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49be177-2bef-45cb-ba94-d162885b8808 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:19.839349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49be177-2bef-45cb-ba94-d162885b8808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:19.924570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d49be177-2bef-45cb-ba94-d162885b8808 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:19.925831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d49be177-2bef-45cb-ba94-d162885b8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:19.992173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1148/2329] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:25:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:20.005560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387629d-6c34-4697-9817-1ded67180384 service glance] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:20.007271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d387629d-6c34-4697-9817-1ded67180384 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:20.117836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387629d-6c34-4697-9817-1ded67180384 service glance] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:20.123620 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45fc5e-6ddf-4d21-8fb4-f4d57375a6bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:20.124267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45fc5e-6ddf-4d21-8fb4-f4d57375a6bb service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:20.124585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45fc5e-6ddf-4d21-8fb4-f4d57375a6bb service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:20.124891 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45fc5e-6ddf-4d21-8fb4-f4d57375a6bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:20.133922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45fc5e-6ddf-4d21-8fb4-f4d57375a6bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:20.135553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45fc5e-6ddf-4d21-8fb4-f4d57375a6bb service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:20.144425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1182/2330] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:25:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 03:25:21.233360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4dd56-4198-44f0-b70d-2c89fd08f73c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:21.234107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4dd56-4198-44f0-b70d-2c89fd08f73c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:21.234588 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4dd56-4198-44f0-b70d-2c89fd08f73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:21.254837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-58b4dd56-4198-44f0-b70d-2c89fd08f73c None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:21.256408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-58b4dd56-4198-44f0-b70d-2c89fd08f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:21.278377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1149/2331] 10.222.0.15 () {58 vars in 967 bytes} [Thu May 26 03:25:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:25:21.294507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45fc5e-6ddf-4d21-8fb4-f4d57375a6bb service swift] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:21.313566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45fc5e-6ddf-4d21-8fb4-f4d57375a6bb service swift] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:21.315097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25909014-e25d-4907-9046-afbd7f61cf17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:21.315748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909014-e25d-4907-9046-afbd7f61cf17 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:21.316047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909014-e25d-4907-9046-afbd7f61cf17 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:21.316353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909014-e25d-4907-9046-afbd7f61cf17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:21.326906 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25909014-e25d-4907-9046-afbd7f61cf17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:21.328927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25909014-e25d-4907-9046-afbd7f61cf17 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:21.338007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1183/2332] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:25:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:25:21.960994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a80e0-b29e-4ad5-92f7-b2a2994e0e3b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:21.961281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a80e0-b29e-4ad5-92f7-b2a2994e0e3b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:21.961558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a80e0-b29e-4ad5-92f7-b2a2994e0e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:21.982755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3f3a80e0-b29e-4ad5-92f7-b2a2994e0e3b None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:21.984037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3f3a80e0-b29e-4ad5-92f7-b2a2994e0e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:21.991699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1150/2333] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:25:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:22.004488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25909014-e25d-4907-9046-afbd7f61cf17 service swift] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:22.014976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25909014-e25d-4907-9046-afbd7f61cf17 service swift] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:22.020461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a552-e44e-4187-976d-271df52ec1cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:22.021155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a552-e44e-4187-976d-271df52ec1cb service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:22.021492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a552-e44e-4187-976d-271df52ec1cb service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:22.021766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a552-e44e-4187-976d-271df52ec1cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:22.030461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2a552-e44e-4187-976d-271df52ec1cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:22.032033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2a552-e44e-4187-976d-271df52ec1cb service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:22.043582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1184/2334] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:25:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 03:25:22.665795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9677a3-8545-422d-9889-b4ca0c551727 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:22.666262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9677a3-8545-422d-9889-b4ca0c551727 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:22.666490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9677a3-8545-422d-9889-b4ca0c551727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:22.684886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3b9677a3-8545-422d-9889-b4ca0c551727 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:22.686091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3b9677a3-8545-422d-9889-b4ca0c551727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:22.693578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1151/2335] 10.222.0.15 () {58 vars in 967 bytes} [Thu May 26 03:25:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:22.706475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a552-e44e-4187-976d-271df52ec1cb service swift] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:22.720049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a552-e44e-4187-976d-271df52ec1cb service swift] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:22.726554 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f1c18-bcf4-445f-afcf-e1694ff4cdc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:22.727272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1c18-bcf4-445f-afcf-e1694ff4cdc9 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:22.727563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1c18-bcf4-445f-afcf-e1694ff4cdc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:22.730400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1c18-bcf4-445f-afcf-e1694ff4cdc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:22.737784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f1c18-bcf4-445f-afcf-e1694ff4cdc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:22.739449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f1c18-bcf4-445f-afcf-e1694ff4cdc9 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:22.761179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1185/2336] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:25:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:25:24.162463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9677a3-8545-422d-9889-b4ca0c551727 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:24.164032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3b9677a3-8545-422d-9889-b4ca0c551727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:24.242674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9677a3-8545-422d-9889-b4ca0c551727 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:24.249093 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:24.254509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:24.254801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:24.255630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] PATH_INFO: `/v3/users/54b80bb6c8254c4098ec8c34da5c8b84` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:24.256989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b80bb6c8254c4098ec8c34da5c8b84)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:24.258940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:24.263480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:24.438520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b80bb6c8254c4098ec8c34da5c8b84'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:24.447002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b80bb6c8254c4098ec8c34da5c8b84'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:24.448151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b80bb6c8254c4098ec8c34da5c8b84'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:24.460337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b80bb6c8254c4098ec8c34da5c8b84'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:24.547187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b80bb6c8254c4098ec8c34da5c8b84'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:24.553917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1152/2337] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:24 2022] DELETE /identity/v3/users/54b80bb6c8254c4098ec8c34da5c8b84 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:24.559483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47665d5b-3a29-4a2c-8938-b67bac559683 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:24.562509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47665d5b-3a29-4a2c-8938-b67bac559683 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:24.562509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47665d5b-3a29-4a2c-8938-b67bac559683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:24.582908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-47665d5b-3a29-4a2c-8938-b67bac559683 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:24.584935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-47665d5b-3a29-4a2c-8938-b67bac559683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:24.650560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1186/2338] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:24.661233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:24.663040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:24.722435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e62e9-7e41-4969-89ec-a5a1ad79c312 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:24.726071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd98e0-9487-41e2-8bf2-e39639d33ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:24.726727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd98e0-9487-41e2-8bf2-e39639d33ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:24.727010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd98e0-9487-41e2-8bf2-e39639d33ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:24.727317 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd98e0-9487-41e2-8bf2-e39639d33ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:24.736972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd98e0-9487-41e2-8bf2-e39639d33ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:24.738428 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd98e0-9487-41e2-8bf2-e39639d33ae6 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:24.748451 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1153/2339] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:25.229664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47665d5b-3a29-4a2c-8938-b67bac559683 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:25.231725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-47665d5b-3a29-4a2c-8938-b67bac559683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:25.246382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47665d5b-3a29-4a2c-8938-b67bac559683 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:25.251307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:25.252191 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:25.252516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:25.252793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] PATH_INFO: `/v3/projects/1b2087a6a3f54b5b9a31d7b9705bd04b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:25.253976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2087a6a3f54b5b9a31d7b9705bd04b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:25.255892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:25.262931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:25.391909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2087a6a3f54b5b9a31d7b9705bd04b', 'request_id': 'req-f27a7e66-d381-46f4-8d46-55d00a7ea594'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.473397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2087a6a3f54b5b9a31d7b9705bd04b', 'request_id': 'req-f27a7e66-d381-46f4-8d46-55d00a7ea594'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.482075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2087a6a3f54b5b9a31d7b9705bd04b', 'request_id': 'req-f27a7e66-d381-46f4-8d46-55d00a7ea594'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.493635 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] The token cache is being invalidate because project 1b2087a6a3f54b5b9a31d7b9705bd04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:25.493926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.494637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.496183 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1187/2340] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:25 2022] DELETE /identity/v3/projects/1b2087a6a3f54b5b9a31d7b9705bd04b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:25:25.500093 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd98e0-9487-41e2-8bf2-e39639d33ae6 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:25.515243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd98e0-9487-41e2-8bf2-e39639d33ae6 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:25.579434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:25.580512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:25.580626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:25.580911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] PATH_INFO: `/v3/users/12aaf2a43f6944d689a25de6e17d5c85` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:25.584996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12aaf2a43f6944d689a25de6e17d5c85)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:25.586939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:25.666686 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:25.670206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:25.681099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a7e66-d381-46f4-8d46-55d00a7ea594 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:25.688142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:25.689266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:25.689551 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:25.689828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] PATH_INFO: `/v3/users/9b24429c27a34f85b4f463ca1434a010` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:25.693185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b24429c27a34f85b4f463ca1434a010)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:25.693185 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:25.749292 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:25.842685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12aaf2a43f6944d689a25de6e17d5c85'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.849700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12aaf2a43f6944d689a25de6e17d5c85'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.850453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12aaf2a43f6944d689a25de6e17d5c85'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.863162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12aaf2a43f6944d689a25de6e17d5c85'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.899929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b24429c27a34f85b4f463ca1434a010'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.900880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b24429c27a34f85b4f463ca1434a010'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.907803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b24429c27a34f85b4f463ca1434a010'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.908472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b24429c27a34f85b4f463ca1434a010'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.920239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b24429c27a34f85b4f463ca1434a010'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.925044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0f185f7e-e188-4892-bd5a-2f4375a5e672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12aaf2a43f6944d689a25de6e17d5c85'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:25.931403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1154/2341] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:25 2022] DELETE /identity/v3/users/12aaf2a43f6944d689a25de6e17d5c85 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:25.966148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1188/2342] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:25 2022] DELETE /identity/v3/users/9b24429c27a34f85b4f463ca1434a010 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:25:25.971274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52480a0-7624-4506-9eca-870f0d003413 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:25.971630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52480a0-7624-4506-9eca-870f0d003413 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:25.972181 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52480a0-7624-4506-9eca-870f0d003413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:25.990844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b52480a0-7624-4506-9eca-870f0d003413 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:25.992412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b52480a0-7624-4506-9eca-870f0d003413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:26.060499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1155/2343] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:26.072512 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:26.074210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:26.136138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6ccbe-e182-4247-8392-8876dc5e6a5c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:26.140796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c16d41-ea17-4f8a-a90d-02005bfc5e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:26.141451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c16d41-ea17-4f8a-a90d-02005bfc5e37 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:26.141736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c16d41-ea17-4f8a-a90d-02005bfc5e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:26.142299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c16d41-ea17-4f8a-a90d-02005bfc5e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:26.153010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c16d41-ea17-4f8a-a90d-02005bfc5e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:26.154481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c16d41-ea17-4f8a-a90d-02005bfc5e37 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:26.164461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1189/2344] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:26.384146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52480a0-7624-4506-9eca-870f0d003413 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:26.385966 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b52480a0-7624-4506-9eca-870f0d003413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:26.399446 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52480a0-7624-4506-9eca-870f0d003413 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:26.404192 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:26.405154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:26.405445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:26.405724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] PATH_INFO: `/v3/projects/39fa182e1026486b9bf1c7cada05eb51` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:26.406912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39fa182e1026486b9bf1c7cada05eb51)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:26.408933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:26.442550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c16d41-ea17-4f8a-a90d-02005bfc5e37 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:26.444091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-79c16d41-ea17-4f8a-a90d-02005bfc5e37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:26.457803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c16d41-ea17-4f8a-a90d-02005bfc5e37 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:26.463251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:26.464475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:26.464660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:26.464917 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] PATH_INFO: `/v3/projects/02ccdd3200804ea0858ccacff8843931` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:26.466741 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ccdd3200804ea0858ccacff8843931)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:26.468751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:26.472716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:26.509405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39fa182e1026486b9bf1c7cada05eb51', 'request_id': 'req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.582639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39fa182e1026486b9bf1c7cada05eb51', 'request_id': 'req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.586387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ccdd3200804ea0858ccacff8843931', 'request_id': 'req-a0c4dd33-2897-49d7-a1de-f0b98a91b751'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.589591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39fa182e1026486b9bf1c7cada05eb51', 'request_id': 'req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.600957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] The token cache is being invalidate because project 39fa182e1026486b9bf1c7cada05eb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:26.601245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.605995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.605995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1156/2345] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:26 2022] DELETE /identity/v3/projects/39fa182e1026486b9bf1c7cada05eb51 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:26.607306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:26.609797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:26.645480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:26.668129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ccdd3200804ea0858ccacff8843931', 'request_id': 'req-a0c4dd33-2897-49d7-a1de-f0b98a91b751'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.674691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ccdd3200804ea0858ccacff8843931', 'request_id': 'req-a0c4dd33-2897-49d7-a1de-f0b98a91b751'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.689849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] The token cache is being invalidate because project 02ccdd3200804ea0858ccacff8843931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:26.690148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.690830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0c4dd33-2897-49d7-a1de-f0b98a91b751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.692599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1190/2346] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:26 2022] DELETE /identity/v3/projects/02ccdd3200804ea0858ccacff8843931 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:25:26.698182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e154e-4e1e-4fc0-9b19-676867a9e11a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:26.698450 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9765157-38ee-44d0-81b3-13d6acf6eff3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:26.698450 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9765157-38ee-44d0-81b3-13d6acf6eff3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:26.698857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9765157-38ee-44d0-81b3-13d6acf6eff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:26.725598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b9765157-38ee-44d0-81b3-13d6acf6eff3 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:26.726964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b9765157-38ee-44d0-81b3-13d6acf6eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:26.761647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:26.763234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:26.763692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:26.763924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] PATH_INFO: `/v3/users/68f8e60e538a47d2901676cf12f0633f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:26.765670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f8e60e538a47d2901676cf12f0633f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:26.769031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:26.807295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1191/2347] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:26.815158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e389-3975-4471-a083-f5d2436d55cb None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:26.815448 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e389-3975-4471-a083-f5d2436d55cb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:26.815725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e389-3975-4471-a083-f5d2436d55cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:26.835534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c566e389-3975-4471-a083-f5d2436d55cb None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:26.836705 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c566e389-3975-4471-a083-f5d2436d55cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:26.844934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1192/2348] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:25:26.849030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e389-3975-4471-a083-f5d2436d55cb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:26.858028 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e389-3975-4471-a083-f5d2436d55cb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:26.863527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0faea-3eb0-48da-82b8-c02738bcab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:26.864355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0faea-3eb0-48da-82b8-c02738bcab42 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:26.864694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0faea-3eb0-48da-82b8-c02738bcab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:26.865083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0faea-3eb0-48da-82b8-c02738bcab42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:26.865821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0faea-3eb0-48da-82b8-c02738bcab42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:25:26.866372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0faea-3eb0-48da-82b8-c02738bcab42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:26.867998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0faea-3eb0-48da-82b8-c02738bcab42 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:26.880886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1193/2349] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:25:26.885118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0faea-3eb0-48da-82b8-c02738bcab42 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:26.895145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0faea-3eb0-48da-82b8-c02738bcab42 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:26.899642 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c9fea-b5c3-4f22-a8cd-51add4b7fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:26.900256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c9fea-b5c3-4f22-a8cd-51add4b7fc3d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:26.900576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c9fea-b5c3-4f22-a8cd-51add4b7fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:26.900860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c9fea-b5c3-4f22-a8cd-51add4b7fc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:26.901523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c9fea-b5c3-4f22-a8cd-51add4b7fc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:26.903412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c9fea-b5c3-4f22-a8cd-51add4b7fc3d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:26.956180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f8e60e538a47d2901676cf12f0633f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.963637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f8e60e538a47d2901676cf12f0633f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.964426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f8e60e538a47d2901676cf12f0633f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:26.976369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f8e60e538a47d2901676cf12f0633f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:27.001492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1194/2350] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:26 2022] POST /identity/v3/projects => generated 395 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:25:27.005572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c9fea-b5c3-4f22-a8cd-51add4b7fc3d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:27.053575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:27.055521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f8e60e538a47d2901676cf12f0633f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:27.066000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1157/2351] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:26 2022] DELETE /identity/v3/users/68f8e60e538a47d2901676cf12f0633f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:25:27.068398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c9fea-b5c3-4f22-a8cd-51add4b7fc3d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:27.128304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687977b-1d4b-4048-8639-c6a2d48901bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:27.129168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687977b-1d4b-4048-8639-c6a2d48901bf admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:27.129421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687977b-1d4b-4048-8639-c6a2d48901bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:27.129639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687977b-1d4b-4048-8639-c6a2d48901bf admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:27.130353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687977b-1d4b-4048-8639-c6a2d48901bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:27.132617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687977b-1d4b-4048-8639-c6a2d48901bf admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:27.222536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1195/2352] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:27 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:25:27.226558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:27.227969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:27.241738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e038ff-d792-4010-821b-37c259d41c39 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:27.248210 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53a687-5bcb-4dcd-ae05-4140a003c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:27.249201 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a687-5bcb-4dcd-ae05-4140a003c2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:27.249570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a687-5bcb-4dcd-ae05-4140a003c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:27.249991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a687-5bcb-4dcd-ae05-4140a003c2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:27.250765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53a687-5bcb-4dcd-ae05-4140a003c2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:27.252516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53a687-5bcb-4dcd-ae05-4140a003c2c6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:27.263337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1158/2353] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:27.267196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687977b-1d4b-4048-8639-c6a2d48901bf admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:27.277874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687977b-1d4b-4048-8639-c6a2d48901bf admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:27.282636 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1bd32-901f-4932-80b6-fcb2630a8c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:27.283333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1bd32-901f-4932-80b6-fcb2630a8c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:27.283611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1bd32-901f-4932-80b6-fcb2630a8c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:27.283982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1bd32-901f-4932-80b6-fcb2630a8c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:27.284783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1bd32-901f-4932-80b6-fcb2630a8c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:27.286484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1bd32-901f-4932-80b6-fcb2630a8c10 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:27.308791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1196/2354] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:25:27.313784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53a687-5bcb-4dcd-ae05-4140a003c2c6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:27.325852 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53a687-5bcb-4dcd-ae05-4140a003c2c6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:27.330675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6f45-3d1e-4079-b3c9-862b8817b137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:27.331676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6f45-3d1e-4079-b3c9-862b8817b137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:27.332036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6f45-3d1e-4079-b3c9-862b8817b137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:27.332446 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6f45-3d1e-4079-b3c9-862b8817b137 admin admin] PATH_INFO: `/v3/projects/f340f3df92e24aa7878cd5c73bcc23f4/users/236dea312eed47038af472717ed00075/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:27.350877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f6f45-3d1e-4079-b3c9-862b8817b137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f340f3df92e24aa7878cd5c73bcc23f4, user_id=236dea312eed47038af472717ed00075, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:27.353717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f6f45-3d1e-4079-b3c9-862b8817b137 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:27.423844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1159/2355] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:27 2022] PUT /identity/v3/projects/f340f3df92e24aa7878cd5c73bcc23f4/users/236dea312eed47038af472717ed00075/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:27.434459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a4813-cfbe-4891-99f4-d2e2a6b7ffb2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:27.434752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a4813-cfbe-4891-99f4-d2e2a6b7ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:27.435037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a4813-cfbe-4891-99f4-d2e2a6b7ffb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:27.464278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-aa4a4813-cfbe-4891-99f4-d2e2a6b7ffb2 None None] MFA Rules not processed for user `236dea312eed47038af472717ed00075`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:27.466067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-aa4a4813-cfbe-4891-99f4-d2e2a6b7ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:27.505365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6f45-3d1e-4079-b3c9-862b8817b137 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:27.510152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0f7f6f45-3d1e-4079-b3c9-862b8817b137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:27.535553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:27.536297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1197/2356] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:27.548812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a4813-cfbe-4891-99f4-d2e2a6b7ffb2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:27.550224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-aa4a4813-cfbe-4891-99f4-d2e2a6b7ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:27.587463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6f45-3d1e-4079-b3c9-862b8817b137 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:27.592836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:27.593700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:27.594018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:27.594301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] PATH_INFO: `/v3/projects/ac6d9fa23aed4f30917d1babaeff0e6d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:27.595492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac6d9fa23aed4f30917d1babaeff0e6d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:27.597642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:27.608526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a4813-cfbe-4891-99f4-d2e2a6b7ffb2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:27.615101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780998b-551a-4cde-9e0b-4575b0dd9144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:27.615815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780998b-551a-4cde-9e0b-4575b0dd9144 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:27.616097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780998b-551a-4cde-9e0b-4575b0dd9144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:27.616402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780998b-551a-4cde-9e0b-4575b0dd9144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:27.625584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780998b-551a-4cde-9e0b-4575b0dd9144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:27.627273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780998b-551a-4cde-9e0b-4575b0dd9144 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:27.636701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1198/2357] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:25:27.728452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac6d9fa23aed4f30917d1babaeff0e6d', 'request_id': 'req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:27.810861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac6d9fa23aed4f30917d1babaeff0e6d', 'request_id': 'req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:27.818854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac6d9fa23aed4f30917d1babaeff0e6d', 'request_id': 'req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:27.832251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] The token cache is being invalidate because project ac6d9fa23aed4f30917d1babaeff0e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:27.840678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:27.840678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1ea1c43a-84f8-46a5-ac76-d298e6b3be5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:27.840678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1160/2358] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:27 2022] DELETE /identity/v3/projects/ac6d9fa23aed4f30917d1babaeff0e6d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:34.522503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780998b-551a-4cde-9e0b-4575b0dd9144 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:34.533899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780998b-551a-4cde-9e0b-4575b0dd9144 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:34.537450 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:34.590257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:34.591124 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:34.591414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:34.591698 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] PATH_INFO: `/v3/users/236dea312eed47038af472717ed00075` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:34.593438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236dea312eed47038af472717ed00075)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:34.595367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:34.783388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236dea312eed47038af472717ed00075'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:34.784056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236dea312eed47038af472717ed00075'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:34.790869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236dea312eed47038af472717ed00075'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:34.791540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236dea312eed47038af472717ed00075'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:34.808840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236dea312eed47038af472717ed00075'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:34.913908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1199/2359] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:34 2022] DELETE /identity/v3/users/236dea312eed47038af472717ed00075 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:34.918431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770bc0d-24f6-42f3-8caf-33b40605c342 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:34.918917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770bc0d-24f6-42f3-8caf-33b40605c342 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:34.919042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770bc0d-24f6-42f3-8caf-33b40605c342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:34.937193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f770bc0d-24f6-42f3-8caf-33b40605c342 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:34.940281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f770bc0d-24f6-42f3-8caf-33b40605c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:34.998997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1161/2360] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:25:35.013193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:35.014972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:35.078130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de463075-a3e0-4bef-899e-e8997729c422 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:35.089699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363e6eb-0dba-4713-9618-9c1eb8a1cbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:35.090377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363e6eb-0dba-4713-9618-9c1eb8a1cbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:35.090657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363e6eb-0dba-4713-9618-9c1eb8a1cbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:35.090933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363e6eb-0dba-4713-9618-9c1eb8a1cbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:35.100660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363e6eb-0dba-4713-9618-9c1eb8a1cbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:35.102080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363e6eb-0dba-4713-9618-9c1eb8a1cbd3 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:35.111970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1200/2361] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:35.596110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770bc0d-24f6-42f3-8caf-33b40605c342 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:35.603791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f770bc0d-24f6-42f3-8caf-33b40605c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:35.612719 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770bc0d-24f6-42f3-8caf-33b40605c342 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:35.617862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:35.618737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:35.619100 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:35.619285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] PATH_INFO: `/v3/projects/f340f3df92e24aa7878cd5c73bcc23f4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:35.620567 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f340f3df92e24aa7878cd5c73bcc23f4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:35.622565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:35.739836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:35.743383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f340f3df92e24aa7878cd5c73bcc23f4', 'request_id': 'req-d187235e-e8d0-4e3c-9b37-6e268c39a423'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:35.805003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f340f3df92e24aa7878cd5c73bcc23f4', 'request_id': 'req-d187235e-e8d0-4e3c-9b37-6e268c39a423'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:35.812182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f340f3df92e24aa7878cd5c73bcc23f4', 'request_id': 'req-d187235e-e8d0-4e3c-9b37-6e268c39a423'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:35.823204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] The token cache is being invalidate because project f340f3df92e24aa7878cd5c73bcc23f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:35.823488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:35.824135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d187235e-e8d0-4e3c-9b37-6e268c39a423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:35.825766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1162/2362] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:35 2022] DELETE /identity/v3/projects/f340f3df92e24aa7878cd5c73bcc23f4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:35.831177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c3ca2-c285-48dc-b0b8-a61266d954ef None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:35.831694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c3ca2-c285-48dc-b0b8-a61266d954ef None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:35.831792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c3ca2-c285-48dc-b0b8-a61266d954ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:35.854835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b67c3ca2-c285-48dc-b0b8-a61266d954ef None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:35.854835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b67c3ca2-c285-48dc-b0b8-a61266d954ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:35.876680 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:35.911421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1201/2363] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:35.918907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3132-8ed5-43f4-806a-a548ba846386 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:35.919424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3132-8ed5-43f4-806a-a548ba846386 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:35.919593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3132-8ed5-43f4-806a-a548ba846386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:35.938609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-dd3f3132-8ed5-43f4-806a-a548ba846386 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:35.939817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dd3f3132-8ed5-43f4-806a-a548ba846386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:35.947819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1163/2364] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:35.952531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c3ca2-c285-48dc-b0b8-a61266d954ef None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:35.963593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c3ca2-c285-48dc-b0b8-a61266d954ef None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:35.968972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362943b-45b9-4e63-9a70-9c52a6cd4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:35.969663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362943b-45b9-4e63-9a70-9c52a6cd4a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:35.969949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362943b-45b9-4e63-9a70-9c52a6cd4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:35.970224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362943b-45b9-4e63-9a70-9c52a6cd4a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:35.970947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362943b-45b9-4e63-9a70-9c52a6cd4a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:25:35.971256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362943b-45b9-4e63-9a70-9c52a6cd4a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:35.972874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362943b-45b9-4e63-9a70-9c52a6cd4a08 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:35.988136 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1202/2365] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:25:35.989477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3132-8ed5-43f4-806a-a548ba846386 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:35.999413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3132-8ed5-43f4-806a-a548ba846386 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:36.004164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f19ed8-5059-4e48-9694-18cc9556ca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:36.004857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f19ed8-5059-4e48-9694-18cc9556ca5c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:36.005150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f19ed8-5059-4e48-9694-18cc9556ca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:36.005428 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f19ed8-5059-4e48-9694-18cc9556ca5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:36.006119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f19ed8-5059-4e48-9694-18cc9556ca5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:36.008056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f19ed8-5059-4e48-9694-18cc9556ca5c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:36.069138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1164/2366] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:35 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:36.073013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362943b-45b9-4e63-9a70-9c52a6cd4a08 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:36.083380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362943b-45b9-4e63-9a70-9c52a6cd4a08 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:36.141060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89f124-dedf-4613-a16f-6d64aa584c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:36.141728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89f124-dedf-4613-a16f-6d64aa584c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:36.142011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89f124-dedf-4613-a16f-6d64aa584c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:36.142284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89f124-dedf-4613-a16f-6d64aa584c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:36.142973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89f124-dedf-4613-a16f-6d64aa584c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:36.144904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89f124-dedf-4613-a16f-6d64aa584c0a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:36.223145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1203/2367] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:36 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:36.227418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f19ed8-5059-4e48-9694-18cc9556ca5c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:36.238668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f19ed8-5059-4e48-9694-18cc9556ca5c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:36.243335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac7cd1-c37c-4d1a-b192-0651eea1998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:36.244021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac7cd1-c37c-4d1a-b192-0651eea1998c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:36.244300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac7cd1-c37c-4d1a-b192-0651eea1998c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:36.244612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac7cd1-c37c-4d1a-b192-0651eea1998c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:36.245371 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac7cd1-c37c-4d1a-b192-0651eea1998c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:36.246980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac7cd1-c37c-4d1a-b192-0651eea1998c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:36.258525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1165/2368] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:36.262441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89f124-dedf-4613-a16f-6d64aa584c0a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:36.272804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89f124-dedf-4613-a16f-6d64aa584c0a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:36.277451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd58822-4045-4619-9dfa-925a61bf8c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:36.278110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58822-4045-4619-9dfa-925a61bf8c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:36.278393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58822-4045-4619-9dfa-925a61bf8c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:36.278675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58822-4045-4619-9dfa-925a61bf8c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:36.279392 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd58822-4045-4619-9dfa-925a61bf8c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:36.281673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd58822-4045-4619-9dfa-925a61bf8c1f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:36.291396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1204/2369] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:36.295308 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac7cd1-c37c-4d1a-b192-0651eea1998c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:36.305168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac7cd1-c37c-4d1a-b192-0651eea1998c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:36.309848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089d8ae-ecd5-4862-9ab2-13d5b17ef1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:36.310714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089d8ae-ecd5-4862-9ab2-13d5b17ef1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:36.311509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089d8ae-ecd5-4862-9ab2-13d5b17ef1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:36.311785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089d8ae-ecd5-4862-9ab2-13d5b17ef1a4 admin admin] PATH_INFO: `/v3/projects/7aafe8235ddf43f196e8213c2623e237/users/f29903032a5449f1a8803870355e8980/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:36.326468 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089d8ae-ecd5-4862-9ab2-13d5b17ef1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aafe8235ddf43f196e8213c2623e237, user_id=f29903032a5449f1a8803870355e8980, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:36.329946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089d8ae-ecd5-4862-9ab2-13d5b17ef1a4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:36.395851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1166/2370] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:36 2022] PUT /identity/v3/projects/7aafe8235ddf43f196e8213c2623e237/users/f29903032a5449f1a8803870355e8980/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:36.401012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd88b84-b370-4fb3-83d8-33202bdb1449 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:36.401305 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd88b84-b370-4fb3-83d8-33202bdb1449 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:36.401587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd88b84-b370-4fb3-83d8-33202bdb1449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:36.420097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ddd88b84-b370-4fb3-83d8-33202bdb1449 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:36.421523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ddd88b84-b370-4fb3-83d8-33202bdb1449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:36.482867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1205/2371] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:36.492515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089d8ae-ecd5-4862-9ab2-13d5b17ef1a4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:36.494226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f089d8ae-ecd5-4862-9ab2-13d5b17ef1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:36.551699 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089d8ae-ecd5-4862-9ab2-13d5b17ef1a4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:36.555300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652f10f-0297-4d8b-b6df-c06242317a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:36.555947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652f10f-0297-4d8b-b6df-c06242317a8e service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:36.556229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652f10f-0297-4d8b-b6df-c06242317a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:36.556540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652f10f-0297-4d8b-b6df-c06242317a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:36.567171 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652f10f-0297-4d8b-b6df-c06242317a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:36.568743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652f10f-0297-4d8b-b6df-c06242317a8e service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:36.580503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1167/2372] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:42.090276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee71c14-afae-4c6e-8ff4-567639842ff6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:42.092880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee71c14-afae-4c6e-8ff4-567639842ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:42.092880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee71c14-afae-4c6e-8ff4-567639842ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:42.124880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9ee71c14-afae-4c6e-8ff4-567639842ff6 None None] MFA Rules not processed for user `f29903032a5449f1a8803870355e8980`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:42.126216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9ee71c14-afae-4c6e-8ff4-567639842ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:42.158582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:42.216817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1206/2373] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:42.221794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652f10f-0297-4d8b-b6df-c06242317a8e service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:42.233133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652f10f-0297-4d8b-b6df-c06242317a8e service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:42.238959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2120-4b56-40b9-857e-8ad3e3deb614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:42.239718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2120-4b56-40b9-857e-8ad3e3deb614 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:42.240087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2120-4b56-40b9-857e-8ad3e3deb614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:42.240465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2120-4b56-40b9-857e-8ad3e3deb614 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:42.242245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2120-4b56-40b9-857e-8ad3e3deb614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:42.244563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2120-4b56-40b9-857e-8ad3e3deb614 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:42.351553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1168/2374] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:42 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:42.355435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee71c14-afae-4c6e-8ff4-567639842ff6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:42.366595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee71c14-afae-4c6e-8ff4-567639842ff6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:42.429853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89be167-d56f-4630-9e39-83832b446386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:42.429988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be167-d56f-4630-9e39-83832b446386 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:42.430294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be167-d56f-4630-9e39-83832b446386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:42.430409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be167-d56f-4630-9e39-83832b446386 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:42.431116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89be167-d56f-4630-9e39-83832b446386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:42.433110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89be167-d56f-4630-9e39-83832b446386 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:42.545720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1207/2375] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:42 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:42.546949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2120-4b56-40b9-857e-8ad3e3deb614 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:42.558736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2120-4b56-40b9-857e-8ad3e3deb614 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:42.565214 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be80816-9dc4-45e2-84c9-99389d0dbb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:42.565890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be80816-9dc4-45e2-84c9-99389d0dbb2e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:42.566175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be80816-9dc4-45e2-84c9-99389d0dbb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:42.566484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be80816-9dc4-45e2-84c9-99389d0dbb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:42.567323 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be80816-9dc4-45e2-84c9-99389d0dbb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:42.569010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be80816-9dc4-45e2-84c9-99389d0dbb2e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:42.581676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1169/2376] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:42.585998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89be167-d56f-4630-9e39-83832b446386 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:42.596255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89be167-d56f-4630-9e39-83832b446386 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:42.601247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97897447-3b24-44f6-a47e-fc69c1b98b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:42.602205 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897447-3b24-44f6-a47e-fc69c1b98b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:42.602569 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897447-3b24-44f6-a47e-fc69c1b98b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:42.602913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897447-3b24-44f6-a47e-fc69c1b98b99 admin admin] PATH_INFO: `/v3/projects/8a582d2e9c6d4b6fa8302accf004b481/users/a7085b920f9f405980b0f2227adc854a/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:42.618812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97897447-3b24-44f6-a47e-fc69c1b98b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a582d2e9c6d4b6fa8302accf004b481, user_id=a7085b920f9f405980b0f2227adc854a, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:42.621662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97897447-3b24-44f6-a47e-fc69c1b98b99 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:42.723734 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1208/2377] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:42 2022] PUT /identity/v3/projects/8a582d2e9c6d4b6fa8302accf004b481/users/a7085b920f9f405980b0f2227adc854a/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:25:42.727693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be80816-9dc4-45e2-84c9-99389d0dbb2e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:42.739360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be80816-9dc4-45e2-84c9-99389d0dbb2e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:42.774486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:42.799590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa366ef1-c141-42fa-b3c5-564f0ace302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:42.802454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa366ef1-c141-42fa-b3c5-564f0ace302c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:42.802454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa366ef1-c141-42fa-b3c5-564f0ace302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:42.802454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa366ef1-c141-42fa-b3c5-564f0ace302c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:42.802454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa366ef1-c141-42fa-b3c5-564f0ace302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:42.803309 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa366ef1-c141-42fa-b3c5-564f0ace302c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:42.814746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1170/2378] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:42.818908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97897447-3b24-44f6-a47e-fc69c1b98b99 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:42.832484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97897447-3b24-44f6-a47e-fc69c1b98b99 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:42.835338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad31408-2a2d-4377-aa4d-c7f994707a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:42.836249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad31408-2a2d-4377-aa4d-c7f994707a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:42.836605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad31408-2a2d-4377-aa4d-c7f994707a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:42.836879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad31408-2a2d-4377-aa4d-c7f994707a3b admin admin] PATH_INFO: `/v3/projects/8a582d2e9c6d4b6fa8302accf004b481/users/a7085b920f9f405980b0f2227adc854a/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:42.838954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad31408-2a2d-4377-aa4d-c7f994707a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a582d2e9c6d4b6fa8302accf004b481, user_id=a7085b920f9f405980b0f2227adc854a, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:42.841614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad31408-2a2d-4377-aa4d-c7f994707a3b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:42.852108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1209/2379] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:42 2022] PUT /identity/v3/projects/8a582d2e9c6d4b6fa8302accf004b481/users/a7085b920f9f405980b0f2227adc854a/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:48.364939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6ac6-6a78-424d-9243-41d8b4404559 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:48.365483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6ac6-6a78-424d-9243-41d8b4404559 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:48.365483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6ac6-6a78-424d-9243-41d8b4404559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:48.397083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-95de6ac6-6a78-424d-9243-41d8b4404559 None None] MFA Rules not processed for user `a7085b920f9f405980b0f2227adc854a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:48.398316 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-95de6ac6-6a78-424d-9243-41d8b4404559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:48.480222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1171/2380] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:48.492831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad31408-2a2d-4377-aa4d-c7f994707a3b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:48.495227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cad31408-2a2d-4377-aa4d-c7f994707a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:48.565812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad31408-2a2d-4377-aa4d-c7f994707a3b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:48.570292 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afdbfd-117e-4de0-a923-971cc7742607 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b95fdb06a94c1586148df32413085f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:48.571361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afdbfd-117e-4de0-a923-971cc7742607 service glance] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:48.571710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afdbfd-117e-4de0-a923-971cc7742607 service glance] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:48.571988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afdbfd-117e-4de0-a923-971cc7742607 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:48.607494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:48.638339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afdbfd-117e-4de0-a923-971cc7742607 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:48.640738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afdbfd-117e-4de0-a923-971cc7742607 service glance] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:48.651528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1210/2381] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:48.890610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f4321-07a3-47be-ad76-84bdab120449 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:48.890825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f4321-07a3-47be-ad76-84bdab120449 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:48.891164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f4321-07a3-47be-ad76-84bdab120449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:48.909619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4e2f4321-07a3-47be-ad76-84bdab120449 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:48.910824 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4e2f4321-07a3-47be-ad76-84bdab120449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:48.976511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1172/2382] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:25:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:48.988480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afdbfd-117e-4de0-a923-971cc7742607 service glance] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:48.989849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f4afdbfd-117e-4de0-a923-971cc7742607 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:49.057232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afdbfd-117e-4de0-a923-971cc7742607 service glance] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:49.062931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1457ca8-8086-4d07-aa5d-da2d6d8ec733 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:49.063571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1457ca8-8086-4d07-aa5d-da2d6d8ec733 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:49.063852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1457ca8-8086-4d07-aa5d-da2d6d8ec733 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:49.064129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1457ca8-8086-4d07-aa5d-da2d6d8ec733 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:49.072597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1457ca8-8086-4d07-aa5d-da2d6d8ec733 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:49.074200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1457ca8-8086-4d07-aa5d-da2d6d8ec733 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:49.082803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1211/2383] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:25:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:25:55.438762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f4321-07a3-47be-ad76-84bdab120449 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:55.440650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4e2f4321-07a3-47be-ad76-84bdab120449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:55.517625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f4321-07a3-47be-ad76-84bdab120449 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:55.524474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:55.525362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:55.525645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:55.525923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] PATH_INFO: `/v3/users/a6a15afdf78848b298acbf1598dc90d6` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:55.527122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a15afdf78848b298acbf1598dc90d6)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:55.529350 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:55.535095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:55.705893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a15afdf78848b298acbf1598dc90d6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:55.714941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a15afdf78848b298acbf1598dc90d6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:55.715749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a15afdf78848b298acbf1598dc90d6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:55.731635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a15afdf78848b298acbf1598dc90d6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:55.793469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a15afdf78848b298acbf1598dc90d6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:55.806676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1173/2384] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:25:55 2022] DELETE /identity/v3/users/a6a15afdf78848b298acbf1598dc90d6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:55.813076 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80fb47-15aa-4fc5-8016-b27243f8ea6b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:55.813662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80fb47-15aa-4fc5-8016-b27243f8ea6b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:55.813662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80fb47-15aa-4fc5-8016-b27243f8ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:55.835767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2e80fb47-15aa-4fc5-8016-b27243f8ea6b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:55.837023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2e80fb47-15aa-4fc5-8016-b27243f8ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:55.906381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1212/2385] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:55.916076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:55.917678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:55.986735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa594711-a990-4657-b842-16fdfc215ac4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:55.990629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3096-8052-4fae-a5ff-7e31970f0f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:55.991369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3096-8052-4fae-a5ff-7e31970f0f73 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:55.991733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3096-8052-4fae-a5ff-7e31970f0f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:55.992082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3096-8052-4fae-a5ff-7e31970f0f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:56.006269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c3096-8052-4fae-a5ff-7e31970f0f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:56.007821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c3096-8052-4fae-a5ff-7e31970f0f73 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:56.024221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1174/2386] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:56.504890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80fb47-15aa-4fc5-8016-b27243f8ea6b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:56.506452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2e80fb47-15aa-4fc5-8016-b27243f8ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:56.521335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80fb47-15aa-4fc5-8016-b27243f8ea6b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:56.529018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:56.530716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:56.531001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:56.531280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] PATH_INFO: `/v3/projects/e10a67ff7d3c4325a2d9c210a3e03d31` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:56.532560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10a67ff7d3c4325a2d9c210a3e03d31)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:56.534551 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:56.646720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10a67ff7d3c4325a2d9c210a3e03d31', 'request_id': 'req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:56.736712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10a67ff7d3c4325a2d9c210a3e03d31', 'request_id': 'req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:56.738319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:56.749586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10a67ff7d3c4325a2d9c210a3e03d31', 'request_id': 'req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:56.764777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] The token cache is being invalidate because project e10a67ff7d3c4325a2d9c210a3e03d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:25:56.765218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:56.766029 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ffba5f87-7fb6-400f-8f3a-1cc90bca14dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:25:56.767650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1213/2387] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:25:56 2022] DELETE /identity/v3/projects/e10a67ff7d3c4325a2d9c210a3e03d31 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:56.772543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223145-2b24-4f1d-ba11-3c821496d38c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:56.773076 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223145-2b24-4f1d-ba11-3c821496d38c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:56.773274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223145-2b24-4f1d-ba11-3c821496d38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:56.796906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-17223145-2b24-4f1d-ba11-3c821496d38c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:56.798366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-17223145-2b24-4f1d-ba11-3c821496d38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:56.883266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1175/2388] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:56.884476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991401c-c629-412d-9d47-add5e6c0408f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:56.884921 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991401c-c629-412d-9d47-add5e6c0408f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:56.885034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991401c-c629-412d-9d47-add5e6c0408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:56.907541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f991401c-c629-412d-9d47-add5e6c0408f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:56.908995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f991401c-c629-412d-9d47-add5e6c0408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:56.918965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1214/2389] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:56.923715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223145-2b24-4f1d-ba11-3c821496d38c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:56.934448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223145-2b24-4f1d-ba11-3c821496d38c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:56.943557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb55cbb-9252-4c14-8380-917634ada817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:56.944229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb55cbb-9252-4c14-8380-917634ada817 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:56.944552 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb55cbb-9252-4c14-8380-917634ada817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:56.944827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb55cbb-9252-4c14-8380-917634ada817 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:56.945557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb55cbb-9252-4c14-8380-917634ada817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:25:56.945876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb55cbb-9252-4c14-8380-917634ada817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:56.947485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb55cbb-9252-4c14-8380-917634ada817 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:56.960544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1176/2390] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:25:56.965024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991401c-c629-412d-9d47-add5e6c0408f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:56.976581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991401c-c629-412d-9d47-add5e6c0408f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:56.981616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38d3fd-4473-4370-83b1-311fbf7f1db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:56.982375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d3fd-4473-4370-83b1-311fbf7f1db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:56.982769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d3fd-4473-4370-83b1-311fbf7f1db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:56.983146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d3fd-4473-4370-83b1-311fbf7f1db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:56.983916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38d3fd-4473-4370-83b1-311fbf7f1db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:56.986279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38d3fd-4473-4370-83b1-311fbf7f1db8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:57.079961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1215/2391] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:25:56 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:25:57.084031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb55cbb-9252-4c14-8380-917634ada817 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:57.095784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb55cbb-9252-4c14-8380-917634ada817 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:57.105424 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:57.168644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b08e5-f679-4533-babc-6b38dbe25260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:57.169324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b08e5-f679-4533-babc-6b38dbe25260 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:57.169606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b08e5-f679-4533-babc-6b38dbe25260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:57.170041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b08e5-f679-4533-babc-6b38dbe25260 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:57.170665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b08e5-f679-4533-babc-6b38dbe25260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:57.172649 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b08e5-f679-4533-babc-6b38dbe25260 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:57.263467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1177/2392] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:25:57 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:25:57.268243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38d3fd-4473-4370-83b1-311fbf7f1db8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:57.278815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38d3fd-4473-4370-83b1-311fbf7f1db8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:57.286860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24356281-685c-4031-bd06-9d8cd8e65009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:57.287547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24356281-685c-4031-bd06-9d8cd8e65009 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:57.287831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24356281-685c-4031-bd06-9d8cd8e65009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:57.288110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24356281-685c-4031-bd06-9d8cd8e65009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:57.288876 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24356281-685c-4031-bd06-9d8cd8e65009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:57.290485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24356281-685c-4031-bd06-9d8cd8e65009 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:57.305323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1216/2393] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:57.309230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b08e5-f679-4533-babc-6b38dbe25260 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:57.322733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b08e5-f679-4533-babc-6b38dbe25260 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:57.328238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec559c6-6dfe-4369-92a8-4c901a894db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:57.328941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec559c6-6dfe-4369-92a8-4c901a894db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:57.329236 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec559c6-6dfe-4369-92a8-4c901a894db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:57.329508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec559c6-6dfe-4369-92a8-4c901a894db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:57.330300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec559c6-6dfe-4369-92a8-4c901a894db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:57.331859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec559c6-6dfe-4369-92a8-4c901a894db2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:57.344893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1178/2394] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:25:57.349094 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24356281-685c-4031-bd06-9d8cd8e65009 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:57.361217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24356281-685c-4031-bd06-9d8cd8e65009 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:57.366302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df270d8e-f5fa-474c-832f-85591c8a96ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:57.367414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df270d8e-f5fa-474c-832f-85591c8a96ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:57.367766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df270d8e-f5fa-474c-832f-85591c8a96ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:57.368224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df270d8e-f5fa-474c-832f-85591c8a96ec admin admin] PATH_INFO: `/v3/projects/b8a19a1df40043e4baece66bdb7e4807/users/0ab0c31033b849c9b28ec42e1de5b6b7/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:57.388003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df270d8e-f5fa-474c-832f-85591c8a96ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a19a1df40043e4baece66bdb7e4807, user_id=0ab0c31033b849c9b28ec42e1de5b6b7, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:57.391464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df270d8e-f5fa-474c-832f-85591c8a96ec admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:57.463206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1217/2395] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:25:57 2022] PUT /identity/v3/projects/b8a19a1df40043e4baece66bdb7e4807/users/0ab0c31033b849c9b28ec42e1de5b6b7/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:25:57.468590 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc405b2-1b5a-4f5e-81b0-0c4646a573aa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:57.469184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc405b2-1b5a-4f5e-81b0-0c4646a573aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:57.469730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc405b2-1b5a-4f5e-81b0-0c4646a573aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:57.491611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1dc405b2-1b5a-4f5e-81b0-0c4646a573aa None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:57.493186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1dc405b2-1b5a-4f5e-81b0-0c4646a573aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:57.572454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1179/2396] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:57.582619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df270d8e-f5fa-474c-832f-85591c8a96ec admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:57.584426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-df270d8e-f5fa-474c-832f-85591c8a96ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:57.656447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df270d8e-f5fa-474c-832f-85591c8a96ec admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:57.660092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dadcaa-63c3-4488-811f-1df2d69bb313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:57.660816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dadcaa-63c3-4488-811f-1df2d69bb313 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:57.661789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dadcaa-63c3-4488-811f-1df2d69bb313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:57.661789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dadcaa-63c3-4488-811f-1df2d69bb313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:57.672795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dadcaa-63c3-4488-811f-1df2d69bb313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:57.674295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dadcaa-63c3-4488-811f-1df2d69bb313 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:57.686932 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1218/2397] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:25:59.246488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9da6-52d0-44fd-95be-a5afd9fee56e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:59.247122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9da6-52d0-44fd-95be-a5afd9fee56e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:59.247122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9da6-52d0-44fd-95be-a5afd9fee56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:59.274143 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-59bd9da6-52d0-44fd-95be-a5afd9fee56e None None] MFA Rules not processed for user `0ab0c31033b849c9b28ec42e1de5b6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:59.275375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-59bd9da6-52d0-44fd-95be-a5afd9fee56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:59.344193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1180/2398] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:25:59.355086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dadcaa-63c3-4488-811f-1df2d69bb313 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:25:59.356506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-52dadcaa-63c3-4488-811f-1df2d69bb313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:59.416107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dadcaa-63c3-4488-811f-1df2d69bb313 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:25:59.419854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddc59e-aa01-489c-8e90-a586ae3f91d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:25:59.420534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc59e-aa01-489c-8e90-a586ae3f91d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:59.420851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc59e-aa01-489c-8e90-a586ae3f91d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:59.421131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc59e-aa01-489c-8e90-a586ae3f91d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:59.429494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddc59e-aa01-489c-8e90-a586ae3f91d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:25:59.430912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddc59e-aa01-489c-8e90-a586ae3f91d6 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:25:59.440459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1219/2399] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:25:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:25:59.658486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdc0e3-1ec8-495a-8453-025db3ba1a98 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:25:59.658776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdc0e3-1ec8-495a-8453-025db3ba1a98 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:25:59.659052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdc0e3-1ec8-495a-8453-025db3ba1a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:25:59.676164 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-26bdc0e3-1ec8-495a-8453-025db3ba1a98 None None] MFA Rules not processed for user `f29903032a5449f1a8803870355e8980`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:25:59.677366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-26bdc0e3-1ec8-495a-8453-025db3ba1a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:25:59.694172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:25:59.731635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1181/2400] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:25:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:26:01.120654 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dea358-65f4-4edf-84c3-db7ae0d630cc None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:01.121175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dea358-65f4-4edf-84c3-db7ae0d630cc None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:01.121280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dea358-65f4-4edf-84c3-db7ae0d630cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:01.139285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-79dea358-65f4-4edf-84c3-db7ae0d630cc None None] MFA Rules not processed for user `0ab0c31033b849c9b28ec42e1de5b6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:26:01.144135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-79dea358-65f4-4edf-84c3-db7ae0d630cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:01.148063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1220/2401] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:26:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:26:01.825774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdc0e3-1ec8-495a-8453-025db3ba1a98 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:26:01.827379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-26bdc0e3-1ec8-495a-8453-025db3ba1a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:01.928284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdc0e3-1ec8-495a-8453-025db3ba1a98 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:26:01.933519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:26:01.934337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:01.934622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:01.936411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:01.939624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:01.952914 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:26:01.954581 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:26:01.965846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1182/2402] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:26:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:26:03.322383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c499d-8f9d-42f3-ac1d-2a3dc1ad41f7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:03.323248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c499d-8f9d-42f3-ac1d-2a3dc1ad41f7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:03.323677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c499d-8f9d-42f3-ac1d-2a3dc1ad41f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:03.343518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8a4c499d-8f9d-42f3-ac1d-2a3dc1ad41f7 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:26:03.346413 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8a4c499d-8f9d-42f3-ac1d-2a3dc1ad41f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:03.360628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:26:03.402399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1221/2403] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:26:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:26:03.420750 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:26:03.422309 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:03.521857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf7cd8-e6ab-4fcf-aa90-dd6306e22138 service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:26:03.527635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b731d-a55b-42f2-9999-afc371a4a4f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:26:03.528301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b731d-a55b-42f2-9999-afc371a4a4f5 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:03.529155 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b731d-a55b-42f2-9999-afc371a4a4f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:03.529434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b731d-a55b-42f2-9999-afc371a4a4f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:03.538345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b731d-a55b-42f2-9999-afc371a4a4f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:26:03.539983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b731d-a55b-42f2-9999-afc371a4a4f5 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:26:03.548617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1183/2404] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:26:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:26:13.544768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:26:13.554681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=16 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:26:37.766672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c499d-8f9d-42f3-ac1d-2a3dc1ad41f7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:26:37.776218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c499d-8f9d-42f3-ac1d-2a3dc1ad41f7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:26:37.779807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441ec1-c1fe-4e82-a0d9-aa40e85312b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:26:37.780494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441ec1-c1fe-4e82-a0d9-aa40e85312b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:37.781282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441ec1-c1fe-4e82-a0d9-aa40e85312b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:37.781557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441ec1-c1fe-4e82-a0d9-aa40e85312b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:37.783497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c5441ec1-c1fe-4e82-a0d9-aa40e85312b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:37.858497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5441ec1-c1fe-4e82-a0d9-aa40e85312b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:26:37.863071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5441ec1-c1fe-4e82-a0d9-aa40e85312b1 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:26:37.870111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1222/2405] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:26:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:26:37.928595 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef202b4-3012-417d-8c60-685ec8ba524b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:37.929541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef202b4-3012-417d-8c60-685ec8ba524b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:37.929960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef202b4-3012-417d-8c60-685ec8ba524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:37.948670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-eef202b4-3012-417d-8c60-685ec8ba524b None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:26:37.951183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-eef202b4-3012-417d-8c60-685ec8ba524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:37.962877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1184/2406] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:26:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:26:37.973750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441ec1-c1fe-4e82-a0d9-aa40e85312b1 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:26:37.986220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441ec1-c1fe-4e82-a0d9-aa40e85312b1 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:26:37.991119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb448c-2692-4983-b856-72dd76a7a7e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:26:37.991759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb448c-2692-4983-b856-72dd76a7a7e5 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:37.992069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb448c-2692-4983-b856-72dd76a7a7e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:37.992370 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb448c-2692-4983-b856-72dd76a7a7e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:38.000722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb448c-2692-4983-b856-72dd76a7a7e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:26:38.002391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb448c-2692-4983-b856-72dd76a7a7e5 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:26:38.010435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1223/2407] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:26:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:26:47.943020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:26:48.007236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=36 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:26:57.431140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a6188-7a58-457d-9b37-73e76887d2cb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:57.432168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a6188-7a58-457d-9b37-73e76887d2cb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:57.432509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a6188-7a58-457d-9b37-73e76887d2cb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:57.434232 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1185/2408] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:26:57.441888 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa754a-0d5f-4c3e-9f3e-fd21c08ab8ab None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:57.442465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa754a-0d5f-4c3e-9f3e-fd21c08ab8ab None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:57.442571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa754a-0d5f-4c3e-9f3e-fd21c08ab8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:57.529281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-57fa754a-0d5f-4c3e-9f3e-fd21c08ab8ab None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:26:57.530603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-57fa754a-0d5f-4c3e-9f3e-fd21c08ab8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:57.615254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1224/2409] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:26:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:26:57.626862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a6188-7a58-457d-9b37-73e76887d2cb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:26:57.628627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5d3a6188-7a58-457d-9b37-73e76887d2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:57.687951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a6188-7a58-457d-9b37-73e76887d2cb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:26:57.691611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4293cc7-ceaf-4065-8fc8-b5581c4c6abb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b95fdb06a94c1586148df32413085f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:26:57.692252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4293cc7-ceaf-4065-8fc8-b5581c4c6abb service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:57.692579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4293cc7-ceaf-4065-8fc8-b5581c4c6abb service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:57.692858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4293cc7-ceaf-4065-8fc8-b5581c4c6abb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:57.702932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4293cc7-ceaf-4065-8fc8-b5581c4c6abb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:26:57.704434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4293cc7-ceaf-4065-8fc8-b5581c4c6abb service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:26:57.715529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1186/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:26:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:26:57.910265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80419bc-5755-4068-8195-831315a1a634 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:57.910559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80419bc-5755-4068-8195-831315a1a634 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:57.910840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80419bc-5755-4068-8195-831315a1a634 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:57.912302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1225/2411] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:26:57.917195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efce21-4ea1-4992-95d2-1df66599da84 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:57.917489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efce21-4ea1-4992-95d2-1df66599da84 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:57.917769 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efce21-4ea1-4992-95d2-1df66599da84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:57.956044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-92efce21-4ea1-4992-95d2-1df66599da84 None None] MFA Rules not processed for user `e22fe8105f01400ab6ac3dc14c7aa7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:26:57.957341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-92efce21-4ea1-4992-95d2-1df66599da84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:57.963873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1187/2412] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:26:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:26:57.975878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80419bc-5755-4068-8195-831315a1a634 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:26:57.977598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b80419bc-5755-4068-8195-831315a1a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:57.991219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80419bc-5755-4068-8195-831315a1a634 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:26:57.994955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ea9d0-27eb-4d1c-a1e7-68a333998929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:26:57.995586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea9d0-27eb-4d1c-a1e7-68a333998929 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:57.995902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea9d0-27eb-4d1c-a1e7-68a333998929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:57.996177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ea9d0-27eb-4d1c-a1e7-68a333998929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:58.003253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ea9d0-27eb-4d1c-a1e7-68a333998929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:26:58.004704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ea9d0-27eb-4d1c-a1e7-68a333998929 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:26:58.012276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1226/2413] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:26:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:26:58.099653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e4dff-3eb2-465a-a5f8-e57196961419 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:58.099974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e4dff-3eb2-465a-a5f8-e57196961419 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:58.100257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e4dff-3eb2-465a-a5f8-e57196961419 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:58.101667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1188/2414] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:26:58.106498 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290be3d-51fd-4520-acaf-a5f4b30f65a0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:58.106793 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290be3d-51fd-4520-acaf-a5f4b30f65a0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:58.107076 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290be3d-51fd-4520-acaf-a5f4b30f65a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:58.125677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c290be3d-51fd-4520-acaf-a5f4b30f65a0 None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:26:58.126869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c290be3d-51fd-4520-acaf-a5f4b30f65a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:26:58.137145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1227/2415] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:26:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:26:58.147358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e4dff-3eb2-465a-a5f8-e57196961419 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:26:58.159133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e4dff-3eb2-465a-a5f8-e57196961419 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:26:58.162984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc73499-8ac3-4101-b82c-7f1e65b9d109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:26:58.163627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc73499-8ac3-4101-b82c-7f1e65b9d109 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:26:58.163912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc73499-8ac3-4101-b82c-7f1e65b9d109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:26:58.164210 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc73499-8ac3-4101-b82c-7f1e65b9d109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:26:58.175020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc73499-8ac3-4101-b82c-7f1e65b9d109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:26:58.176831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc73499-8ac3-4101-b82c-7f1e65b9d109 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:26:58.186957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1189/2416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:26:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:27:00.386362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06da87-1b48-4ae0-b018-388a14bbb17a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:00.386899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06da87-1b48-4ae0-b018-388a14bbb17a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:00.386899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06da87-1b48-4ae0-b018-388a14bbb17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:00.406088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-cf06da87-1b48-4ae0-b018-388a14bbb17a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:00.407262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cf06da87-1b48-4ae0-b018-388a14bbb17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:00.414932 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1228/2417] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:27:00.434359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc73499-8ac3-4101-b82c-7f1e65b9d109 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:00.435768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ddc73499-8ac3-4101-b82c-7f1e65b9d109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:00.451647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc73499-8ac3-4101-b82c-7f1e65b9d109 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:00.457808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e89134-2313-4401-bde0-b45acc21d22d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:00.458459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e89134-2313-4401-bde0-b45acc21d22d service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:00.458742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e89134-2313-4401-bde0-b45acc21d22d service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:00.459020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e89134-2313-4401-bde0-b45acc21d22d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:00.467343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e89134-2313-4401-bde0-b45acc21d22d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:00.468990 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e89134-2313-4401-bde0-b45acc21d22d service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:00.478819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1190/2418] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:27:02.952909 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5613-dfaf-44a0-a736-36c0cc681010 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:02.953375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5613-dfaf-44a0-a736-36c0cc681010 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:02.953605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5613-dfaf-44a0-a736-36c0cc681010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:02.971403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-cb0b5613-dfaf-44a0-a736-36c0cc681010 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:02.972613 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cb0b5613-dfaf-44a0-a736-36c0cc681010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:02.980053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1229/2419] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:27:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:27:03.002434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e89134-2313-4401-bde0-b45acc21d22d service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:03.013561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e89134-2313-4401-bde0-b45acc21d22d service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:03.018571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346c9b4-9c45-4b8e-90e4-0edc7592b977 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:03.019343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346c9b4-9c45-4b8e-90e4-0edc7592b977 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:03.019647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346c9b4-9c45-4b8e-90e4-0edc7592b977 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:03.019909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346c9b4-9c45-4b8e-90e4-0edc7592b977 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:03.027881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346c9b4-9c45-4b8e-90e4-0edc7592b977 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:03.029540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346c9b4-9c45-4b8e-90e4-0edc7592b977 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:03.037525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1191/2420] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:27:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:27:05.562202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df485285-4777-40ff-a09b-d995aa3a2c50 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:05.563014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df485285-4777-40ff-a09b-d995aa3a2c50 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:05.563421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df485285-4777-40ff-a09b-d995aa3a2c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:05.583742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-df485285-4777-40ff-a09b-d995aa3a2c50 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:05.585101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-df485285-4777-40ff-a09b-d995aa3a2c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:05.593435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1230/2421] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:27:05.608322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346c9b4-9c45-4b8e-90e4-0edc7592b977 service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:05.620897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346c9b4-9c45-4b8e-90e4-0edc7592b977 service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:05.628072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060cd40-b6db-4396-b3f5-9ca0f81bc9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:05.629071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060cd40-b6db-4396-b3f5-9ca0f81bc9d4 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:05.629464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060cd40-b6db-4396-b3f5-9ca0f81bc9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:05.629949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060cd40-b6db-4396-b3f5-9ca0f81bc9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:05.639869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060cd40-b6db-4396-b3f5-9ca0f81bc9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:05.641628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060cd40-b6db-4396-b3f5-9ca0f81bc9d4 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:05.652777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1192/2422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:27:15.578080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=64 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:27:15.648030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=59 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:27:26.406608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae0482-ea86-415b-a423-39b878b97176 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:26.407056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae0482-ea86-415b-a423-39b878b97176 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:26.407153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae0482-ea86-415b-a423-39b878b97176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:26.427062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a6ae0482-ea86-415b-a423-39b878b97176 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:26.428280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a6ae0482-ea86-415b-a423-39b878b97176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:26.437766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1231/2423] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:27:26.549670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060cd40-b6db-4396-b3f5-9ca0f81bc9d4 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:26.561114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060cd40-b6db-4396-b3f5-9ca0f81bc9d4 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:26.567044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae323d-01f3-4900-b4de-77a554d60029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:26.567675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae323d-01f3-4900-b4de-77a554d60029 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:26.567955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae323d-01f3-4900-b4de-77a554d60029 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:26.568268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae323d-01f3-4900-b4de-77a554d60029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:26.576411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae323d-01f3-4900-b4de-77a554d60029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:26.578053 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae323d-01f3-4900-b4de-77a554d60029 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:26.587311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1193/2424] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:27:27.709609 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735a0c-6226-4201-b344-a0b456a57500 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:27.710103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735a0c-6226-4201-b344-a0b456a57500 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:27.710236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735a0c-6226-4201-b344-a0b456a57500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:27.732797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-62735a0c-6226-4201-b344-a0b456a57500 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:27.734216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-62735a0c-6226-4201-b344-a0b456a57500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:27.741914 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1232/2425] 10.222.0.15 () {58 vars in 967 bytes} [Thu May 26 03:27:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:27:27.756690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae323d-01f3-4900-b4de-77a554d60029 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:27.767834 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae323d-01f3-4900-b4de-77a554d60029 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:27.772796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642f91c-cd67-46f0-af47-0983824cdeb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:27.773432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f91c-cd67-46f0-af47-0983824cdeb2 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:27.773722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f91c-cd67-46f0-af47-0983824cdeb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:27.774069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f91c-cd67-46f0-af47-0983824cdeb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:27.782027 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642f91c-cd67-46f0-af47-0983824cdeb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:27.783745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642f91c-cd67-46f0-af47-0983824cdeb2 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:27.792122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1194/2426] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:27:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 03:27:30.273908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdf6f8-19b4-45fb-aa7d-ecc012851534 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:30.274403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdf6f8-19b4-45fb-aa7d-ecc012851534 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:30.274516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdf6f8-19b4-45fb-aa7d-ecc012851534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:30.291967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e9cdf6f8-19b4-45fb-aa7d-ecc012851534 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:30.293184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e9cdf6f8-19b4-45fb-aa7d-ecc012851534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:30.300929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1233/2427] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:27:30.321429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642f91c-cd67-46f0-af47-0983824cdeb2 service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:30.333774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642f91c-cd67-46f0-af47-0983824cdeb2 service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:30.339170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab278d2-a235-4506-9325-44aff95fd32d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:30.339798 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab278d2-a235-4506-9325-44aff95fd32d service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:30.340085 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab278d2-a235-4506-9325-44aff95fd32d service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:30.340391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab278d2-a235-4506-9325-44aff95fd32d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:30.348606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab278d2-a235-4506-9325-44aff95fd32d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:30.350202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab278d2-a235-4506-9325-44aff95fd32d service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:30.359724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1195/2428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:27:34.509780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627da84-6b48-4994-b23e-16b6fd20a887 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:34.510241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627da84-6b48-4994-b23e-16b6fd20a887 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:34.510387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627da84-6b48-4994-b23e-16b6fd20a887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:34.527831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f627da84-6b48-4994-b23e-16b6fd20a887 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:34.529043 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f627da84-6b48-4994-b23e-16b6fd20a887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:34.536745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1234/2429] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:27:34.576251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab278d2-a235-4506-9325-44aff95fd32d service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:34.577658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8ab278d2-a235-4506-9325-44aff95fd32d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:34.592003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab278d2-a235-4506-9325-44aff95fd32d service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:34.597458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6508ed0-4ba7-4c02-b3ad-e6272aedc77e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:34.598032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6508ed0-4ba7-4c02-b3ad-e6272aedc77e service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:34.598313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6508ed0-4ba7-4c02-b3ad-e6272aedc77e service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:34.598588 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6508ed0-4ba7-4c02-b3ad-e6272aedc77e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:34.606470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6508ed0-4ba7-4c02-b3ad-e6272aedc77e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:34.608052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6508ed0-4ba7-4c02-b3ad-e6272aedc77e service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:34.617784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1196/2430] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:27:38.830820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c312426-e295-45ff-8a39-34c8bad3c649 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:38.831839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c312426-e295-45ff-8a39-34c8bad3c649 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:38.831944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c312426-e295-45ff-8a39-34c8bad3c649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:38.850213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8c312426-e295-45ff-8a39-34c8bad3c649 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:38.851388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8c312426-e295-45ff-8a39-34c8bad3c649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:38.859178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1235/2431] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:27:38.874069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6508ed0-4ba7-4c02-b3ad-e6272aedc77e service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:38.885216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6508ed0-4ba7-4c02-b3ad-e6272aedc77e service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:38.890840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce941e-1fe9-49ae-b6c6-3af36e94d016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:38.891472 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce941e-1fe9-49ae-b6c6-3af36e94d016 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:38.891754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce941e-1fe9-49ae-b6c6-3af36e94d016 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:38.892028 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce941e-1fe9-49ae-b6c6-3af36e94d016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:38.900728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce941e-1fe9-49ae-b6c6-3af36e94d016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:38.902306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce941e-1fe9-49ae-b6c6-3af36e94d016 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:38.912151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1197/2432] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:27:48.844473 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=15 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:27:48.907305 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=30 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:27:50.779254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c312426-e295-45ff-8a39-34c8bad3c649 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:50.789375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c312426-e295-45ff-8a39-34c8bad3c649 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:50.793240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415cfbc-03ce-4a57-a19d-826e6e504b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:50.793890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415cfbc-03ce-4a57-a19d-826e6e504b32 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:50.794170 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415cfbc-03ce-4a57-a19d-826e6e504b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:50.794446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415cfbc-03ce-4a57-a19d-826e6e504b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:50.796425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b415cfbc-03ce-4a57-a19d-826e6e504b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:50.810706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415cfbc-03ce-4a57-a19d-826e6e504b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:50.812174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415cfbc-03ce-4a57-a19d-826e6e504b32 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:50.823889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1236/2433] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:27:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:27:52.073258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce941e-1fe9-49ae-b6c6-3af36e94d016 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:27:52.083152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce941e-1fe9-49ae-b6c6-3af36e94d016 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:27:52.086911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c06f50-52fc-420a-a8a2-e342d30e258b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:27:52.087674 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06f50-52fc-420a-a8a2-e342d30e258b service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:52.087964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06f50-52fc-420a-a8a2-e342d30e258b service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:52.088257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06f50-52fc-420a-a8a2-e342d30e258b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:52.090263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-61c06f50-52fc-420a-a8a2-e342d30e258b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:52.106715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c06f50-52fc-420a-a8a2-e342d30e258b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:27:52.108298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c06f50-52fc-420a-a8a2-e342d30e258b service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:27:52.122031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1198/2434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:27:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:27:54.822307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39709529-afca-4e2e-94c2-36c1c288b983 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:54.822758 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39709529-afca-4e2e-94c2-36c1c288b983 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:54.822854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39709529-afca-4e2e-94c2-36c1c288b983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:54.839935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-39709529-afca-4e2e-94c2-36c1c288b983 None None] MFA Rules not processed for user `ce295e83877040b2869cd06409d93c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:54.841095 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-39709529-afca-4e2e-94c2-36c1c288b983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:54.895240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1237/2435] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:27:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:27:59.754617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c05a1-c7d2-4120-adfb-e185f1f260e0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:27:59.755133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c05a1-c7d2-4120-adfb-e185f1f260e0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:27:59.755242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c05a1-c7d2-4120-adfb-e185f1f260e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:27:59.773240 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-808c05a1-c7d2-4120-adfb-e185f1f260e0 None None] MFA Rules not processed for user `0ab0c31033b849c9b28ec42e1de5b6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:27:59.774428 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-808c05a1-c7d2-4120-adfb-e185f1f260e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:27:59.781223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1199/2436] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:27:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:27:59.994578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39709529-afca-4e2e-94c2-36c1c288b983 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:00.005222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c05a1-c7d2-4120-adfb-e185f1f260e0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:00.007457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39709529-afca-4e2e-94c2-36c1c288b983 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:00.013051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:00.013702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:00.013987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:00.014266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:00.015135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c05a1-c7d2-4120-adfb-e185f1f260e0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:00.016536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:00.018732 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f7070-2584-4e7f-b57f-89bd3221dc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:00.019364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f7070-2584-4e7f-b57f-89bd3221dc81 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:00.019647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f7070-2584-4e7f-b57f-89bd3221dc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:00.019923 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f7070-2584-4e7f-b57f-89bd3221dc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:00.022158 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-190f7070-2584-4e7f-b57f-89bd3221dc81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:00.027687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:00.029293 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:00.031410 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f7070-2584-4e7f-b57f-89bd3221dc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:00.032882 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f7070-2584-4e7f-b57f-89bd3221dc81 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:00.039195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1238/2437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:27:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:00.041379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1200/2438] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:28:00.538083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:00.539523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:00.554084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4c5c9-b395-4b37-8c73-6cbf6ff20641 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:00.559334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69cc08-b603-4301-b8fc-423d5c886ea2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:00.559985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69cc08-b603-4301-b8fc-423d5c886ea2 service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:00.560274 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69cc08-b603-4301-b8fc-423d5c886ea2 service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:00.560583 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69cc08-b603-4301-b8fc-423d5c886ea2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:00.562659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7b69cc08-b603-4301-b8fc-423d5c886ea2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:00.575125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69cc08-b603-4301-b8fc-423d5c886ea2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:00.576747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69cc08-b603-4301-b8fc-423d5c886ea2 service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:00.586851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1239/2439] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:03.262082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f7070-2584-4e7f-b57f-89bd3221dc81 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:03.270645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f7070-2584-4e7f-b57f-89bd3221dc81 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:03.274881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf437a02-64e6-4c86-b568-8569c02c3175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:03.275511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437a02-64e6-4c86-b568-8569c02c3175 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:03.275792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437a02-64e6-4c86-b568-8569c02c3175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:03.277310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437a02-64e6-4c86-b568-8569c02c3175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:03.277807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bf437a02-64e6-4c86-b568-8569c02c3175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:03.287268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf437a02-64e6-4c86-b568-8569c02c3175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:03.288757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf437a02-64e6-4c86-b568-8569c02c3175 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:03.296863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1201/2440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:10.582557 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=43 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:28:13.293249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=21 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:28:19.603687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ea8d1-cb7a-4185-b73d-e01ddfb8eb2a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:19.604244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ea8d1-cb7a-4185-b73d-e01ddfb8eb2a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:19.604244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ea8d1-cb7a-4185-b73d-e01ddfb8eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:19.622006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4e3ea8d1-cb7a-4185-b73d-e01ddfb8eb2a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:28:19.623184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4e3ea8d1-cb7a-4185-b73d-e01ddfb8eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:19.630898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1240/2441] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:28:19.645248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf437a02-64e6-4c86-b568-8569c02c3175 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:19.659110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf437a02-64e6-4c86-b568-8569c02c3175 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:19.664486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca6bd-9a58-4881-9525-d3f3822293fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:19.665126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca6bd-9a58-4881-9525-d3f3822293fb service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:19.665409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca6bd-9a58-4881-9525-d3f3822293fb service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:19.665685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca6bd-9a58-4881-9525-d3f3822293fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:19.673889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ca6bd-9a58-4881-9525-d3f3822293fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:19.675466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ca6bd-9a58-4881-9525-d3f3822293fb service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:19.685045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1202/2442] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:24.002529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142aa27-2161-4e7b-a5ad-e39c4cd62fee None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:24.003063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142aa27-2161-4e7b-a5ad-e39c4cd62fee None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:24.003207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142aa27-2161-4e7b-a5ad-e39c4cd62fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:24.021646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f142aa27-2161-4e7b-a5ad-e39c4cd62fee None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:28:24.022835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f142aa27-2161-4e7b-a5ad-e39c4cd62fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:24.031067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1241/2443] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:28:24.045744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca6bd-9a58-4881-9525-d3f3822293fb service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:24.057321 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca6bd-9a58-4881-9525-d3f3822293fb service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:24.062904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f21428-b0a0-42cd-8168-e20dc2eff4f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:24.063530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f21428-b0a0-42cd-8168-e20dc2eff4f7 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:24.063819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f21428-b0a0-42cd-8168-e20dc2eff4f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:24.064096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f21428-b0a0-42cd-8168-e20dc2eff4f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:24.072066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f21428-b0a0-42cd-8168-e20dc2eff4f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:24.073680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f21428-b0a0-42cd-8168-e20dc2eff4f7 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:24.082859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1203/2444] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:27.945984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cf7df-ec59-4979-8878-6bbc429767e1 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:27.946415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cf7df-ec59-4979-8878-6bbc429767e1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:27.946679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cf7df-ec59-4979-8878-6bbc429767e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:27.965398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e38cf7df-ec59-4979-8878-6bbc429767e1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:28:27.966580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e38cf7df-ec59-4979-8878-6bbc429767e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:27.974712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1242/2445] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:28:28.011739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f21428-b0a0-42cd-8168-e20dc2eff4f7 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:28.022704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f21428-b0a0-42cd-8168-e20dc2eff4f7 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:28.029452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79671cc3-80a5-4a9f-9ce3-0134f2a041b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:28.029452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79671cc3-80a5-4a9f-9ce3-0134f2a041b4 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:28.029452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79671cc3-80a5-4a9f-9ce3-0134f2a041b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:28.029452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79671cc3-80a5-4a9f-9ce3-0134f2a041b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:28.038250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79671cc3-80a5-4a9f-9ce3-0134f2a041b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:28.040478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79671cc3-80a5-4a9f-9ce3-0134f2a041b4 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:28.050311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1204/2446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:31.433330 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cf7df-ec59-4979-8878-6bbc429767e1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:31.434725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e38cf7df-ec59-4979-8878-6bbc429767e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:31.446655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cf7df-ec59-4979-8878-6bbc429767e1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:31.450171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626b46-a9ee-4624-859b-a8fd2621d6c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:31.450805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626b46-a9ee-4624-859b-a8fd2621d6c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:31.451089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626b46-a9ee-4624-859b-a8fd2621d6c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:31.451373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626b46-a9ee-4624-859b-a8fd2621d6c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:31.453080 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-87626b46-a9ee-4624-859b-a8fd2621d6c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:31.510685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87626b46-a9ee-4624-859b-a8fd2621d6c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:31.512108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87626b46-a9ee-4624-859b-a8fd2621d6c3 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:31.520988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1243/2447] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:33.242896 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481ca67-58ec-44aa-886c-fba6a29061e6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:33.243383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481ca67-58ec-44aa-886c-fba6a29061e6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:33.243504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481ca67-58ec-44aa-886c-fba6a29061e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:33.261778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4481ca67-58ec-44aa-886c-fba6a29061e6 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:28:33.262976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4481ca67-58ec-44aa-886c-fba6a29061e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:33.270897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1205/2448] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:28:33.286033 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626b46-a9ee-4624-859b-a8fd2621d6c3 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:33.298723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626b46-a9ee-4624-859b-a8fd2621d6c3 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:33.304195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5d21b-f5a8-43b9-b874-d01c07b98261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:33.304816 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5d21b-f5a8-43b9-b874-d01c07b98261 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:33.305101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5d21b-f5a8-43b9-b874-d01c07b98261 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:33.305379 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5d21b-f5a8-43b9-b874-d01c07b98261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:33.314179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5d21b-f5a8-43b9-b874-d01c07b98261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:33.315748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5d21b-f5a8-43b9-b874-d01c07b98261 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:33.327160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1244/2449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:35.743157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481ca67-58ec-44aa-886c-fba6a29061e6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:35.757880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481ca67-58ec-44aa-886c-fba6a29061e6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:35.764423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ccab-39ea-40d0-9e20-c4d40d607c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:35.765471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ccab-39ea-40d0-9e20-c4d40d607c2d service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:35.765977 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ccab-39ea-40d0-9e20-c4d40d607c2d service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:35.766416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ccab-39ea-40d0-9e20-c4d40d607c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:35.768492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0cd7ccab-39ea-40d0-9e20-c4d40d607c2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:35.782915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7ccab-39ea-40d0-9e20-c4d40d607c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:35.784962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7ccab-39ea-40d0-9e20-c4d40d607c2d service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:35.798080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1206/2450] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:38.575189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404b9e-b943-4d99-ab1a-f9258ddb54b2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:38.575701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404b9e-b943-4d99-ab1a-f9258ddb54b2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:38.575701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404b9e-b943-4d99-ab1a-f9258ddb54b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:38.597543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b8404b9e-b943-4d99-ab1a-f9258ddb54b2 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:28:38.604468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b8404b9e-b943-4d99-ab1a-f9258ddb54b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:38.611152 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1245/2451] 10.222.0.21 () {58 vars in 1016 bytes} [Thu May 26 03:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:28:38.626062 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ccab-39ea-40d0-9e20-c4d40d607c2d service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:38.637402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ccab-39ea-40d0-9e20-c4d40d607c2d service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:38.644246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769bbe-7565-433c-bc6b-4cd52d1144f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:38.644246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769bbe-7565-433c-bc6b-4cd52d1144f9 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:38.644246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769bbe-7565-433c-bc6b-4cd52d1144f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:38.644246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769bbe-7565-433c-bc6b-4cd52d1144f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:38.653039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3769bbe-7565-433c-bc6b-4cd52d1144f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:38.654869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3769bbe-7565-433c-bc6b-4cd52d1144f9 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:38.664368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1207/2452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:40.845489 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3423b-1110-4bc9-bc60-c11751347aad None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:40.845985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3423b-1110-4bc9-bc60-c11751347aad None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:40.845985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3423b-1110-4bc9-bc60-c11751347aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:40.851687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=47 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:28:40.863538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b3f3423b-1110-4bc9-bc60-c11751347aad None None] MFA Rules not processed for user `0f64029bc0664a158b32340b3cbdb311`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:28:40.864782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b3f3423b-1110-4bc9-bc60-c11751347aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:40.872004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1246/2453] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:28:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:28:41.226254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769bbe-7565-433c-bc6b-4cd52d1144f9 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:41.236636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769bbe-7565-433c-bc6b-4cd52d1144f9 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:41.240901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771831b-85ba-43c1-8427-765b5861c23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:41.241558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771831b-85ba-43c1-8427-765b5861c23a service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:41.241838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771831b-85ba-43c1-8427-765b5861c23a service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:41.242245 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771831b-85ba-43c1-8427-765b5861c23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:41.244598 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0771831b-85ba-43c1-8427-765b5861c23a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:41.254416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771831b-85ba-43c1-8427-765b5861c23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:41.255891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771831b-85ba-43c1-8427-765b5861c23a service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:41.264130 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1208/2454] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:48.821749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8bdc4-5c24-4640-8ee8-4bba69c89c72 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:48.825541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8bdc4-5c24-4640-8ee8-4bba69c89c72 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:48.825541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8bdc4-5c24-4640-8ee8-4bba69c89c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:48.840440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-37f8bdc4-5c24-4640-8ee8-4bba69c89c72 None None] MFA Rules not processed for user `53490cc482c149eaa28f80b868dba094`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:28:48.841634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-37f8bdc4-5c24-4640-8ee8-4bba69c89c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:48.895294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1247/2455] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:28:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:28:51.260482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=39 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:28:56.212602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771831b-85ba-43c1-8427-765b5861c23a service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:28:56.229919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771831b-85ba-43c1-8427-765b5861c23a service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:28:56.235842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b914-08f9-4dfc-af60-1df8f6dfa5f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:28:56.236552 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b914-08f9-4dfc-af60-1df8f6dfa5f6 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:28:56.236841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b914-08f9-4dfc-af60-1df8f6dfa5f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:28:56.237120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b914-08f9-4dfc-af60-1df8f6dfa5f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:28:56.238891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0a23b914-08f9-4dfc-af60-1df8f6dfa5f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:28:56.253122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23b914-08f9-4dfc-af60-1df8f6dfa5f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:28:56.254740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23b914-08f9-4dfc-af60-1df8f6dfa5f6 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:28:56.268791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1209/2456] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:28:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:28:58.888711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=27 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:01.372198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8bdc4-5c24-4640-8ee8-4bba69c89c72 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:01.388544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8bdc4-5c24-4640-8ee8-4bba69c89c72 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:01.394173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad68ef-5aa0-4b49-8054-7a4b6d218efd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:01.394814 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad68ef-5aa0-4b49-8054-7a4b6d218efd service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:01.395815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad68ef-5aa0-4b49-8054-7a4b6d218efd service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:01.395815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad68ef-5aa0-4b49-8054-7a4b6d218efd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:01.397541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a0ad68ef-5aa0-4b49-8054-7a4b6d218efd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:01.412585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad68ef-5aa0-4b49-8054-7a4b6d218efd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:01.414201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad68ef-5aa0-4b49-8054-7a4b6d218efd service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:01.425990 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1248/2457] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:29:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:29:03.685139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b914-08f9-4dfc-af60-1df8f6dfa5f6 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:03.696709 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b914-08f9-4dfc-af60-1df8f6dfa5f6 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:03.703131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac1797-cd4d-4fa7-8cea-1a8774a674ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:03.703768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac1797-cd4d-4fa7-8cea-1a8774a674ea service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:03.704058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac1797-cd4d-4fa7-8cea-1a8774a674ea service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:03.704358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac1797-cd4d-4fa7-8cea-1a8774a674ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:03.706152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-94ac1797-cd4d-4fa7-8cea-1a8774a674ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:03.716246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac1797-cd4d-4fa7-8cea-1a8774a674ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:03.717861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac1797-cd4d-4fa7-8cea-1a8774a674ea service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:03.726587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1210/2458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:29:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:29:11.421396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=6 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:13.722507 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=12 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:17.833060 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309e154-3921-40af-9573-a436289bf04e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:17.833538 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309e154-3921-40af-9573-a436289bf04e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:17.833642 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309e154-3921-40af-9573-a436289bf04e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:17.835018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1249/2459] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:29:17.871263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77cff-ba40-402a-afcc-057bdcb4b568 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:17.877311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77cff-ba40-402a-afcc-057bdcb4b568 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:17.877311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77cff-ba40-402a-afcc-057bdcb4b568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:17.911628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-98a77cff-ba40-402a-afcc-057bdcb4b568 None None] MFA Rules not processed for user `257d9a088fa04cd5af48d6e4fb8b2f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:29:17.911628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-98a77cff-ba40-402a-afcc-057bdcb4b568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:17.918690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1211/2460] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:29:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:29:17.929273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309e154-3921-40af-9573-a436289bf04e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:17.942874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309e154-3921-40af-9573-a436289bf04e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:17.948359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c332039-8e32-48b7-971d-a16ed0ca37a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:17.948967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c332039-8e32-48b7-971d-a16ed0ca37a1 service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:17.949248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c332039-8e32-48b7-971d-a16ed0ca37a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:17.949521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c332039-8e32-48b7-971d-a16ed0ca37a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:17.957712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c332039-8e32-48b7-971d-a16ed0ca37a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:17.959258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c332039-8e32-48b7-971d-a16ed0ca37a1 service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:17.969555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1250/2461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:29:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:29:18.009241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77cff-ba40-402a-afcc-057bdcb4b568 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:18.018806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77cff-ba40-402a-afcc-057bdcb4b568 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:18.023439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:18.024301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:18.024652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:18.024950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] PATH_INFO: `/v3/users/0ab0c31033b849c9b28ec42e1de5b6b7` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:18.026801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab0c31033b849c9b28ec42e1de5b6b7)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:18.028849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:18.278383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab0c31033b849c9b28ec42e1de5b6b7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.285142 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab0c31033b849c9b28ec42e1de5b6b7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.285795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab0c31033b849c9b28ec42e1de5b6b7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.297486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab0c31033b849c9b28ec42e1de5b6b7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.378376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab0c31033b849c9b28ec42e1de5b6b7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.384391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1212/2462] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:29:18 2022] DELETE /identity/v3/users/0ab0c31033b849c9b28ec42e1de5b6b7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:29:18.614368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c332039-8e32-48b7-971d-a16ed0ca37a1 service placement] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:18.626036 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c332039-8e32-48b7-971d-a16ed0ca37a1 service placement] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:18.683996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:18.684872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:18.685172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:18.685436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] PATH_INFO: `/v3/projects/b8a19a1df40043e4baece66bdb7e4807` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:18.686869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a19a1df40043e4baece66bdb7e4807)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:18.688850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:18.797737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a19a1df40043e4baece66bdb7e4807', 'request_id': 'req-bd0bb069-7bfd-49ab-9e70-a87c1f976279'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.859377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a19a1df40043e4baece66bdb7e4807', 'request_id': 'req-bd0bb069-7bfd-49ab-9e70-a87c1f976279'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.865226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a19a1df40043e4baece66bdb7e4807', 'request_id': 'req-bd0bb069-7bfd-49ab-9e70-a87c1f976279'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.876720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] The token cache is being invalidate because project b8a19a1df40043e4baece66bdb7e4807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:29:18.877006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.877719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:18.879231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1251/2463] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:29:18 2022] DELETE /identity/v3/projects/b8a19a1df40043e4baece66bdb7e4807 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:29:26.657972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:26.659375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:26.715180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805c7a8-a36a-431f-b6a7-4aef69d3f964 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:26.760723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c9011-e9d6-4fe9-a035-3731cb3cdef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:26.761922 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c9011-e9d6-4fe9-a035-3731cb3cdef6 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:26.762204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c9011-e9d6-4fe9-a035-3731cb3cdef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:26.762475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c9011-e9d6-4fe9-a035-3731cb3cdef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:26.764226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-635c9011-e9d6-4fe9-a035-3731cb3cdef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:26.784782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:26.826651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c9011-e9d6-4fe9-a035-3731cb3cdef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:26.828131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c9011-e9d6-4fe9-a035-3731cb3cdef6 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:26.837667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1213/2464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:29:28.873773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:30.451193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:30.452648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:30.465829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bb069-7bfd-49ab-9e70-a87c1f976279 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:30.471201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:30.472088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:30.472413 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:30.472717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] PATH_INFO: `/v3/users/ce295e83877040b2869cd06409d93c26` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:30.473934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce295e83877040b2869cd06409d93c26)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:30.475965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:30.679680 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce295e83877040b2869cd06409d93c26'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:30.680334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce295e83877040b2869cd06409d93c26'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:30.687689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce295e83877040b2869cd06409d93c26'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:30.688262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce295e83877040b2869cd06409d93c26'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:30.700970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fbba2250-1dc0-441b-b430-37ab50203268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce295e83877040b2869cd06409d93c26'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:30.762502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1252/2465] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:29:30 2022] DELETE /identity/v3/users/ce295e83877040b2869cd06409d93c26 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:29:31.025944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c9011-e9d6-4fe9-a035-3731cb3cdef6 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:31.036502 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c9011-e9d6-4fe9-a035-3731cb3cdef6 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:31.093762 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:31.094631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.094925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.095204 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] PATH_INFO: `/v3/projects/a6c82030994c42f2be7027dd2c352efd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.096416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c82030994c42f2be7027dd2c352efd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:31.098354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:31.191305 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c82030994c42f2be7027dd2c352efd', 'request_id': 'req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:31.253522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c82030994c42f2be7027dd2c352efd', 'request_id': 'req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:31.259787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c82030994c42f2be7027dd2c352efd', 'request_id': 'req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:31.270786 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] The token cache is being invalidate because project a6c82030994c42f2be7027dd2c352efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:29:31.271014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:31.271639 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fcbb6ddb-fdb2-4b2c-9b42-323330c77159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:31.273187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1214/2466] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:29:31 2022] DELETE /identity/v3/projects/a6c82030994c42f2be7027dd2c352efd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:29:31.278208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b09a6-7859-4d54-8f92-ea85272f6113 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.278523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b09a6-7859-4d54-8f92-ea85272f6113 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.278805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b09a6-7859-4d54-8f92-ea85272f6113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.296605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6b8b09a6-7859-4d54-8f92-ea85272f6113 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:29:31.297791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6b8b09a6-7859-4d54-8f92-ea85272f6113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:31.355943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1253/2467] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:29:31.363740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde3e1-6723-4929-ae6c-54d70ca316ae None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.364030 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde3e1-6723-4929-ae6c-54d70ca316ae None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.364331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde3e1-6723-4929-ae6c-54d70ca316ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.383063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2cdde3e1-6723-4929-ae6c-54d70ca316ae None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:29:31.384367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2cdde3e1-6723-4929-ae6c-54d70ca316ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:31.393034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1215/2468] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:29:31.397250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b09a6-7859-4d54-8f92-ea85272f6113 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:31.406755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b09a6-7859-4d54-8f92-ea85272f6113 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:31.411216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad92601-de1f-426b-b8f8-990aaa5050ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:31.411852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad92601-de1f-426b-b8f8-990aaa5050ae admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.412134 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad92601-de1f-426b-b8f8-990aaa5050ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.412445 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad92601-de1f-426b-b8f8-990aaa5050ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.413164 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad92601-de1f-426b-b8f8-990aaa5050ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:29:31.413471 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad92601-de1f-426b-b8f8-990aaa5050ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:31.415066 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad92601-de1f-426b-b8f8-990aaa5050ae admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:31.426954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1254/2469] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:29:31.431156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde3e1-6723-4929-ae6c-54d70ca316ae None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:31.441280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde3e1-6723-4929-ae6c-54d70ca316ae None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:31.445886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b0e22-1517-4faf-ad8a-55e7eaa759df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:31.446525 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b0e22-1517-4faf-ad8a-55e7eaa759df admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.446811 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b0e22-1517-4faf-ad8a-55e7eaa759df admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.447096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b0e22-1517-4faf-ad8a-55e7eaa759df admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.447773 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b0e22-1517-4faf-ad8a-55e7eaa759df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:31.449734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b0e22-1517-4faf-ad8a-55e7eaa759df admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:31.598453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1216/2470] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:29:31 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:29:31.602595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad92601-de1f-426b-b8f8-990aaa5050ae admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:31.612976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad92601-de1f-426b-b8f8-990aaa5050ae admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:31.671514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0827-1bd6-4ea5-920f-1aeca45f1cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:31.672175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0827-1bd6-4ea5-920f-1aeca45f1cec admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.672483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0827-1bd6-4ea5-920f-1aeca45f1cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.672755 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0827-1bd6-4ea5-920f-1aeca45f1cec admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.673524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a0827-1bd6-4ea5-920f-1aeca45f1cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:31.675412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a0827-1bd6-4ea5-920f-1aeca45f1cec admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:31.681863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:31.740511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1255/2471] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:29:31 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:29:31.744337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b0e22-1517-4faf-ad8a-55e7eaa759df admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:31.755014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b0e22-1517-4faf-ad8a-55e7eaa759df admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:31.759603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118b9ac-ed6f-4996-97de-95ad8c73690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:31.760258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118b9ac-ed6f-4996-97de-95ad8c73690a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.760568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118b9ac-ed6f-4996-97de-95ad8c73690a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.760845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118b9ac-ed6f-4996-97de-95ad8c73690a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.761565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118b9ac-ed6f-4996-97de-95ad8c73690a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:31.763178 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118b9ac-ed6f-4996-97de-95ad8c73690a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:31.768787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:31.773937 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1217/2472] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:29:31.779082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0827-1bd6-4ea5-920f-1aeca45f1cec admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:31.792787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0827-1bd6-4ea5-920f-1aeca45f1cec admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:31.798729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adb5ff-0597-409a-916b-1dfeab194c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:31.799393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adb5ff-0597-409a-916b-1dfeab194c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.799675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adb5ff-0597-409a-916b-1dfeab194c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.799947 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adb5ff-0597-409a-916b-1dfeab194c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.801034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adb5ff-0597-409a-916b-1dfeab194c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:31.802305 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adb5ff-0597-409a-916b-1dfeab194c70 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:31.812645 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1256/2473] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:29:31.816981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118b9ac-ed6f-4996-97de-95ad8c73690a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:31.827363 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118b9ac-ed6f-4996-97de-95ad8c73690a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:31.832426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3dfd5-acaf-4dce-b31c-3417c305c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:31.833314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3dfd5-acaf-4dce-b31c-3417c305c4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.833602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3dfd5-acaf-4dce-b31c-3417c305c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.833879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3dfd5-acaf-4dce-b31c-3417c305c4ec admin admin] PATH_INFO: `/v3/projects/aab4f98c3f8f41abad705003d15e1de6/users/2fdd0ca923f844dc92d769f25f366d13/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.850102 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3dfd5-acaf-4dce-b31c-3417c305c4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab4f98c3f8f41abad705003d15e1de6, user_id=2fdd0ca923f844dc92d769f25f366d13, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:31.852831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3dfd5-acaf-4dce-b31c-3417c305c4ec admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:31.946991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1218/2474] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:29:31 2022] PUT /identity/v3/projects/aab4f98c3f8f41abad705003d15e1de6/users/2fdd0ca923f844dc92d769f25f366d13/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:29:31.952151 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd798-2591-414e-9fee-ee52d37b13ba None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:31.952576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd798-2591-414e-9fee-ee52d37b13ba None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:31.952923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd798-2591-414e-9fee-ee52d37b13ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:31.971125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-343fd798-2591-414e-9fee-ee52d37b13ba None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:29:31.972330 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-343fd798-2591-414e-9fee-ee52d37b13ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:32.032406 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1257/2475] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:29:32.043792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3dfd5-acaf-4dce-b31c-3417c305c4ec admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:32.045577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a9a3dfd5-acaf-4dce-b31c-3417c305c4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:32.102359 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3dfd5-acaf-4dce-b31c-3417c305c4ec admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:32.106643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb07d0b-2363-4079-9ebf-c767e16cbdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:32.107295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb07d0b-2363-4079-9ebf-c767e16cbdad service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:32.107579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb07d0b-2363-4079-9ebf-c767e16cbdad service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:32.107858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb07d0b-2363-4079-9ebf-c767e16cbdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:32.117345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb07d0b-2363-4079-9ebf-c767e16cbdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:32.118828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb07d0b-2363-4079-9ebf-c767e16cbdad service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:32.128585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1219/2476] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:29:37.895499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d59a-8c62-4a3b-beb6-e353a3511048 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:37.896052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d59a-8c62-4a3b-beb6-e353a3511048 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:37.896052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d59a-8c62-4a3b-beb6-e353a3511048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:37.923822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-63f6d59a-8c62-4a3b-beb6-e353a3511048 None None] MFA Rules not processed for user `2fdd0ca923f844dc92d769f25f366d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:29:37.925071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-63f6d59a-8c62-4a3b-beb6-e353a3511048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:37.994567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1258/2477] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:29:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:29:38.009357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb07d0b-2363-4079-9ebf-c767e16cbdad service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:38.011486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1bb07d0b-2363-4079-9ebf-c767e16cbdad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:38.087880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb07d0b-2363-4079-9ebf-c767e16cbdad service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:38.094003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d0958-1d45-41cb-965e-824aacd21b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:38.094655 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d0958-1d45-41cb-965e-824aacd21b28 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:38.094940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d0958-1d45-41cb-965e-824aacd21b28 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:38.095216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d0958-1d45-41cb-965e-824aacd21b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:38.103949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d0958-1d45-41cb-965e-824aacd21b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:38.106170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d0958-1d45-41cb-965e-824aacd21b28 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:38.115951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1220/2478] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:29:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:29:40.486066 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb4a4-6911-494a-8c6d-d4b5c975d39e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:40.486922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb4a4-6911-494a-8c6d-d4b5c975d39e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:40.487399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb4a4-6911-494a-8c6d-d4b5c975d39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:40.510410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d85fb4a4-6911-494a-8c6d-d4b5c975d39e None None] MFA Rules not processed for user `2fdd0ca923f844dc92d769f25f366d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:29:40.511781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d85fb4a4-6911-494a-8c6d-d4b5c975d39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:40.524874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1259/2479] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:29:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:29:42.447557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9a703-cbbf-4045-bc0b-bdbf4033a36f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:42.451448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9a703-cbbf-4045-bc0b-bdbf4033a36f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:42.451448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9a703-cbbf-4045-bc0b-bdbf4033a36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:42.465740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-97e9a703-cbbf-4045-bc0b-bdbf4033a36f None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:29:42.466957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-97e9a703-cbbf-4045-bc0b-bdbf4033a36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:42.525565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1221/2480] 10.222.0.15 () {58 vars in 967 bytes} [Thu May 26 03:29:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:29:42.692740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fb4a4-6911-494a-8c6d-d4b5c975d39e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:42.692740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d85fb4a4-6911-494a-8c6d-d4b5c975d39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:42.754789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:42.759070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fb4a4-6911-494a-8c6d-d4b5c975d39e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:42.764748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8a70f-10c5-45bc-88c0-a642e424ea64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:42.765396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8a70f-10c5-45bc-88c0-a642e424ea64 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:42.765708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8a70f-10c5-45bc-88c0-a642e424ea64 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:42.765989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8a70f-10c5-45bc-88c0-a642e424ea64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:42.774202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8a70f-10c5-45bc-88c0-a642e424ea64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:42.777957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8a70f-10c5-45bc-88c0-a642e424ea64 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:42.784553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1260/2481] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:29:47.534065 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9a703-cbbf-4045-bc0b-bdbf4033a36f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:47.535529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-97e9a703-cbbf-4045-bc0b-bdbf4033a36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:47.548724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:47.608779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9a703-cbbf-4045-bc0b-bdbf4033a36f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:47.613985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd077d-756c-4a94-94bd-b07c3d14ec23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:47.614671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd077d-756c-4a94-94bd-b07c3d14ec23 service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:47.614973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd077d-756c-4a94-94bd-b07c3d14ec23 service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:47.615260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd077d-756c-4a94-94bd-b07c3d14ec23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:47.617054 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-33bd077d-756c-4a94-94bd-b07c3d14ec23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:47.629498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd077d-756c-4a94-94bd-b07c3d14ec23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:47.631092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd077d-756c-4a94-94bd-b07c3d14ec23 service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:47.643633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1222/2482] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:29:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:29:51.236209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8a70f-10c5-45bc-88c0-a642e424ea64 service swift] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:51.237710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-73d8a70f-10c5-45bc-88c0-a642e424ea64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:51.252389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8a70f-10c5-45bc-88c0-a642e424ea64 service swift] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:51.256948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:51.257822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:51.258108 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:51.258385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] PATH_INFO: `/v3/users/f29903032a5449f1a8803870355e8980` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:51.259556 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29903032a5449f1a8803870355e8980)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:51.261536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:51.495023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29903032a5449f1a8803870355e8980'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:51.495677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29903032a5449f1a8803870355e8980'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:51.502658 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29903032a5449f1a8803870355e8980'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:51.503275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29903032a5449f1a8803870355e8980'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:51.515488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29903032a5449f1a8803870355e8980'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:51.595724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1261/2483] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:29:51 2022] DELETE /identity/v3/users/f29903032a5449f1a8803870355e8980 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:29:52.187031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd077d-756c-4a94-94bd-b07c3d14ec23 service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:52.198095 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd077d-756c-4a94-94bd-b07c3d14ec23 service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:52.264208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:52.265173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:52.265466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:52.265747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] PATH_INFO: `/v3/projects/7aafe8235ddf43f196e8213c2623e237` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:52.267047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aafe8235ddf43f196e8213c2623e237)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:52.269110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:52.392840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aafe8235ddf43f196e8213c2623e237', 'request_id': 'req-c4e24a24-b54e-4340-b01c-f942f7857367'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.505391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aafe8235ddf43f196e8213c2623e237', 'request_id': 'req-c4e24a24-b54e-4340-b01c-f942f7857367'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.513732 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aafe8235ddf43f196e8213c2623e237', 'request_id': 'req-c4e24a24-b54e-4340-b01c-f942f7857367'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.525120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] The token cache is being invalidate because project 7aafe8235ddf43f196e8213c2623e237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:29:52.525517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.526887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.531369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1223/2484] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:29:52 2022] DELETE /identity/v3/projects/7aafe8235ddf43f196e8213c2623e237 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:29:52.532552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:52.534000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:52.546778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba50508-80ad-468d-aa73-38e6a6eacb26 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:52.607766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:52.609070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:52.609358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:52.609663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] PATH_INFO: `/v3/users/a7085b920f9f405980b0f2227adc854a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:52.610911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7085b920f9f405980b0f2227adc854a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:52.612933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:52.816997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7085b920f9f405980b0f2227adc854a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.817653 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7085b920f9f405980b0f2227adc854a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.825510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7085b920f9f405980b0f2227adc854a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.826323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7085b920f9f405980b0f2227adc854a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.834049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:52.839399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7085b920f9f405980b0f2227adc854a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:52.927533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1262/2485] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:29:52 2022] DELETE /identity/v3/users/a7085b920f9f405980b0f2227adc854a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:29:53.220262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:29:53.221871 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:29:53.235733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24a24-b54e-4340-b01c-f942f7857367 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:29:53.266965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:29:53.301919 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:29:53.302785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:29:53.303068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:29:53.303341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] PATH_INFO: `/v3/projects/8a582d2e9c6d4b6fa8302accf004b481` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:29:53.304569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a582d2e9c6d4b6fa8302accf004b481)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:29:53.307185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:29:53.400047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a582d2e9c6d4b6fa8302accf004b481', 'request_id': 'req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:53.457571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a582d2e9c6d4b6fa8302accf004b481', 'request_id': 'req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:53.463989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a582d2e9c6d4b6fa8302accf004b481', 'request_id': 'req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:53.474016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] The token cache is being invalidate because project 8a582d2e9c6d4b6fa8302accf004b481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:29:53.478656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:53.478656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:29:53.478656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1224/2486] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:29:53 2022] DELETE /identity/v3/projects/8a582d2e9c6d4b6fa8302accf004b481 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:30:03.743883 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=5,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:30:03.950202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:30:42.702349 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:42.703762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:42.761501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbf1b8-db98-4942-bd1c-d45e473b560f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:42.809357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c8e8-7ca1-4b34-b89a-9ad4a7aab888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:42.810013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c8e8-7ca1-4b34-b89a-9ad4a7aab888 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:42.810298 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c8e8-7ca1-4b34-b89a-9ad4a7aab888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:42.810876 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c8e8-7ca1-4b34-b89a-9ad4a7aab888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:42.813277 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3b78c8e8-7ca1-4b34-b89a-9ad4a7aab888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:42.874308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78c8e8-7ca1-4b34-b89a-9ad4a7aab888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:42.875720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78c8e8-7ca1-4b34-b89a-9ad4a7aab888 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:42.885086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1263/2487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:30:46.458953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:46.460541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:46.474643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf12b-ee46-4371-8ce5-3ba3551ae78a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:46.479051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:46.480189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:46.480698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:46.480985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] PATH_INFO: `/v3/users/0f64029bc0664a158b32340b3cbdb311` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:46.482191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f64029bc0664a158b32340b3cbdb311)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:46.484480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:46.690256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f64029bc0664a158b32340b3cbdb311'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:46.697920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f64029bc0664a158b32340b3cbdb311'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:46.698900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f64029bc0664a158b32340b3cbdb311'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:46.715057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f64029bc0664a158b32340b3cbdb311'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:46.795696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7641a732-f069-4ba4-a9d6-eef4b21e2212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f64029bc0664a158b32340b3cbdb311'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:46.802434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1225/2488] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:30:46 2022] DELETE /identity/v3/users/0f64029bc0664a158b32340b3cbdb311 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:30:47.054263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c8e8-7ca1-4b34-b89a-9ad4a7aab888 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:47.065012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c8e8-7ca1-4b34-b89a-9ad4a7aab888 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:47.126481 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:47.127332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.127617 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.127892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] PATH_INFO: `/v3/projects/b2043ed2909749b285cbf780e30fa943` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.129095 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2043ed2909749b285cbf780e30fa943)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:47.131018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:47.138632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:30:47.239903 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2043ed2909749b285cbf780e30fa943', 'request_id': 'req-a6d89f1e-0a7a-460a-851a-a82ee20accd5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:47.302580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2043ed2909749b285cbf780e30fa943', 'request_id': 'req-a6d89f1e-0a7a-460a-851a-a82ee20accd5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:47.308693 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2043ed2909749b285cbf780e30fa943', 'request_id': 'req-a6d89f1e-0a7a-460a-851a-a82ee20accd5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:47.320787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] The token cache is being invalidate because project b2043ed2909749b285cbf780e30fa943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:30:47.321004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:47.321640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a6d89f1e-0a7a-460a-851a-a82ee20accd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:47.323173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1264/2489] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:30:47 2022] DELETE /identity/v3/projects/b2043ed2909749b285cbf780e30fa943 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:30:47.328134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8981e-1bcd-4b72-b092-28f07557ec0a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.328516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8981e-1bcd-4b72-b092-28f07557ec0a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.328864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8981e-1bcd-4b72-b092-28f07557ec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.347608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-84c8981e-1bcd-4b72-b092-28f07557ec0a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:30:47.348935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-84c8981e-1bcd-4b72-b092-28f07557ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:47.410127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1226/2490] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:30:47.418092 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93baf0-b683-423c-a8a6-532e31ab0e39 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.418380 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93baf0-b683-423c-a8a6-532e31ab0e39 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.418663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93baf0-b683-423c-a8a6-532e31ab0e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.438019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5e93baf0-b683-423c-a8a6-532e31ab0e39 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:30:47.439291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5e93baf0-b683-423c-a8a6-532e31ab0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:47.447248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1265/2491] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:30:47.451835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8981e-1bcd-4b72-b092-28f07557ec0a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:47.461434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8981e-1bcd-4b72-b092-28f07557ec0a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:47.465996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52921285-ef28-4c67-9f97-e60760f05d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:47.466644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921285-ef28-4c67-9f97-e60760f05d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.467438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921285-ef28-4c67-9f97-e60760f05d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.467712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921285-ef28-4c67-9f97-e60760f05d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.468456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52921285-ef28-4c67-9f97-e60760f05d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:30:47.468766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52921285-ef28-4c67-9f97-e60760f05d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:47.470383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52921285-ef28-4c67-9f97-e60760f05d38 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:47.481643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1227/2492] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:30:47.486385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93baf0-b683-423c-a8a6-532e31ab0e39 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:47.495494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93baf0-b683-423c-a8a6-532e31ab0e39 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:47.500229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b1046-b573-41a3-b897-93b4b542bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:47.500982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1046-b573-41a3-b897-93b4b542bf12 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.501266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1046-b573-41a3-b897-93b4b542bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.501541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1046-b573-41a3-b897-93b4b542bf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.502215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b1046-b573-41a3-b897-93b4b542bf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:47.504114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b1046-b573-41a3-b897-93b4b542bf12 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:47.590951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1266/2493] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:30:47 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:30:47.595560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52921285-ef28-4c67-9f97-e60760f05d38 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:47.605436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52921285-ef28-4c67-9f97-e60760f05d38 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:47.659833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9d634-4115-461c-addf-6c1f310d3d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:47.660511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d634-4115-461c-addf-6c1f310d3d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.660793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d634-4115-461c-addf-6c1f310d3d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.661068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d634-4115-461c-addf-6c1f310d3d24 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.661738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9d634-4115-461c-addf-6c1f310d3d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:47.663648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9d634-4115-461c-addf-6c1f310d3d24 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:47.670965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:30:47.738469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1228/2494] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:30:47 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:30:47.742558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b1046-b573-41a3-b897-93b4b542bf12 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:47.752565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b1046-b573-41a3-b897-93b4b542bf12 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:47.757120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd4d7-99d5-4c32-be68-9b4a908a4050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:47.757770 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd4d7-99d5-4c32-be68-9b4a908a4050 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.758053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd4d7-99d5-4c32-be68-9b4a908a4050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.758327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd4d7-99d5-4c32-be68-9b4a908a4050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.759034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fd4d7-99d5-4c32-be68-9b4a908a4050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:47.760660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fd4d7-99d5-4c32-be68-9b4a908a4050 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:47.770763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1267/2495] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:30:47.774724 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9d634-4115-461c-addf-6c1f310d3d24 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:47.785543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9d634-4115-461c-addf-6c1f310d3d24 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:47.790344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ec315-3a91-465f-bfe3-6e53ddff1915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:47.791007 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ec315-3a91-465f-bfe3-6e53ddff1915 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.791291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ec315-3a91-465f-bfe3-6e53ddff1915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.791567 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ec315-3a91-465f-bfe3-6e53ddff1915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.792284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ec315-3a91-465f-bfe3-6e53ddff1915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:47.793921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ec315-3a91-465f-bfe3-6e53ddff1915 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:47.804780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1229/2496] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:30:47.808830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd4d7-99d5-4c32-be68-9b4a908a4050 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:47.818967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fd4d7-99d5-4c32-be68-9b4a908a4050 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:47.823461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc094c5-946f-4223-85ae-ad9220c71bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:47.824339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc094c5-946f-4223-85ae-ad9220c71bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.824656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc094c5-946f-4223-85ae-ad9220c71bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.824933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc094c5-946f-4223-85ae-ad9220c71bae admin admin] PATH_INFO: `/v3/projects/8237e7016f884737a20cc1555ee128de/users/6c6c7f3cb2ae4eaab31ebdc0d881d936/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.839749 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc094c5-946f-4223-85ae-ad9220c71bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8237e7016f884737a20cc1555ee128de, user_id=6c6c7f3cb2ae4eaab31ebdc0d881d936, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:47.843139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc094c5-946f-4223-85ae-ad9220c71bae admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:47.930967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1268/2497] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:30:47 2022] PUT /identity/v3/projects/8237e7016f884737a20cc1555ee128de/users/6c6c7f3cb2ae4eaab31ebdc0d881d936/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:30:47.941456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa0e1b-de31-4b68-a3ad-1e21cdcc6284 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:47.941745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa0e1b-de31-4b68-a3ad-1e21cdcc6284 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:47.942042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa0e1b-de31-4b68-a3ad-1e21cdcc6284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:47.968885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-eaaa0e1b-de31-4b68-a3ad-1e21cdcc6284 None None] MFA Rules not processed for user `6c6c7f3cb2ae4eaab31ebdc0d881d936`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:30:47.970080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-eaaa0e1b-de31-4b68-a3ad-1e21cdcc6284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:48.031999 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1230/2498] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:30:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:30:48.043012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc094c5-946f-4223-85ae-ad9220c71bae admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:48.044750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bdc094c5-946f-4223-85ae-ad9220c71bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:48.116547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc094c5-946f-4223-85ae-ad9220c71bae admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:48.122061 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5cd17-e4f2-46fa-8a58-a440f37d3285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:48.122701 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5cd17-e4f2-46fa-8a58-a440f37d3285 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:48.122981 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5cd17-e4f2-46fa-8a58-a440f37d3285 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:48.123256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5cd17-e4f2-46fa-8a58-a440f37d3285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:48.130980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5cd17-e4f2-46fa-8a58-a440f37d3285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:48.132565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5cd17-e4f2-46fa-8a58-a440f37d3285 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:48.141683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1269/2499] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:30:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:30:50.449874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8f533-3423-4cff-b10f-890ec032f7b3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:50.450401 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8f533-3423-4cff-b10f-890ec032f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:50.450489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8f533-3423-4cff-b10f-890ec032f7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:50.469466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-13e8f533-3423-4cff-b10f-890ec032f7b3 None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:30:50.471380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13e8f533-3423-4cff-b10f-890ec032f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:50.527186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1231/2500] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:30:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:30:50.673542 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5cd17-e4f2-46fa-8a58-a440f37d3285 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:50.675236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-97a5cd17-e4f2-46fa-8a58-a440f37d3285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:50.700007 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:30:50.751582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5cd17-e4f2-46fa-8a58-a440f37d3285 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:50.756655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d70bbe-fa03-40de-bf4c-dd81253e1759 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:50.757306 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70bbe-fa03-40de-bf4c-dd81253e1759 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:50.757592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70bbe-fa03-40de-bf4c-dd81253e1759 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:50.757864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d70bbe-fa03-40de-bf4c-dd81253e1759 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:50.767491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d70bbe-fa03-40de-bf4c-dd81253e1759 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:50.769160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d70bbe-fa03-40de-bf4c-dd81253e1759 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:50.777300 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1270/2501] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:30:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:30:54.212949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8f533-3423-4cff-b10f-890ec032f7b3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:54.287734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8f533-3423-4cff-b10f-890ec032f7b3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:54.293575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:54.294621 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:54.295465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:54.295743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] PATH_INFO: `/v3/users/6c6c7f3cb2ae4eaab31ebdc0d881d936` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:54.296969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6c7f3cb2ae4eaab31ebdc0d881d936)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:54.298962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:54.315597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:30:54.499370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6c7f3cb2ae4eaab31ebdc0d881d936'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:54.506985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6c7f3cb2ae4eaab31ebdc0d881d936'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:54.507987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6c7f3cb2ae4eaab31ebdc0d881d936'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:54.523242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6c7f3cb2ae4eaab31ebdc0d881d936'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:54.592777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6c7f3cb2ae4eaab31ebdc0d881d936'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:54.599718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1232/2502] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:30:54 2022] DELETE /identity/v3/users/6c6c7f3cb2ae4eaab31ebdc0d881d936 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:30:54.605851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f20b3-a71a-4622-934b-e8667ca4ad22 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:54.606996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f20b3-a71a-4622-934b-e8667ca4ad22 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:54.607650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f20b3-a71a-4622-934b-e8667ca4ad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:54.632368 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1c4f20b3-a71a-4622-934b-e8667ca4ad22 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:30:54.635676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1c4f20b3-a71a-4622-934b-e8667ca4ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:54.730852 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1271/2503] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:30:54.745477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:54.747045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:54.823831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c68f-2bc2-4688-9638-25e00970cf13 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:54.829154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31647b37-42bc-4ae6-a70a-45102bc1c774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:54.830169 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31647b37-42bc-4ae6-a70a-45102bc1c774 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:54.830784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31647b37-42bc-4ae6-a70a-45102bc1c774 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:54.830920 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31647b37-42bc-4ae6-a70a-45102bc1c774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:54.841679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31647b37-42bc-4ae6-a70a-45102bc1c774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:54.843812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31647b37-42bc-4ae6-a70a-45102bc1c774 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:54.859159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1233/2504] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:30:55.278327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f20b3-a71a-4622-934b-e8667ca4ad22 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:55.279913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1c4f20b3-a71a-4622-934b-e8667ca4ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:55.302506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f20b3-a71a-4622-934b-e8667ca4ad22 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:55.307935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:55.309112 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:55.309439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:55.309721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] PATH_INFO: `/v3/projects/8237e7016f884737a20cc1555ee128de` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:55.311918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8237e7016f884737a20cc1555ee128de)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:55.313986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:55.411780 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8237e7016f884737a20cc1555ee128de', 'request_id': 'req-6b7dd740-0a1d-48b8-9f10-2ce374da523c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:55.479811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8237e7016f884737a20cc1555ee128de', 'request_id': 'req-6b7dd740-0a1d-48b8-9f10-2ce374da523c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:55.489781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8237e7016f884737a20cc1555ee128de', 'request_id': 'req-6b7dd740-0a1d-48b8-9f10-2ce374da523c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:55.503372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] The token cache is being invalidate because project 8237e7016f884737a20cc1555ee128de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:30:55.503854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:55.504622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6b7dd740-0a1d-48b8-9f10-2ce374da523c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:30:55.506930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1272/2505] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:30:55 2022] DELETE /identity/v3/projects/8237e7016f884737a20cc1555ee128de => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:30:55.512547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b30bd-d734-4e0a-8b45-ba86d6bec7b9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:55.513097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b30bd-d734-4e0a-8b45-ba86d6bec7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:55.513195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b30bd-d734-4e0a-8b45-ba86d6bec7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:55.533679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-998b30bd-d734-4e0a-8b45-ba86d6bec7b9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:30:55.534805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-998b30bd-d734-4e0a-8b45-ba86d6bec7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:55.605260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1234/2506] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:30:55.615069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4681-5ba1-4a16-b0d3-d9593367705d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:55.615773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4681-5ba1-4a16-b0d3-d9593367705d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:55.616067 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4681-5ba1-4a16-b0d3-d9593367705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:55.637091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-eb8a4681-5ba1-4a16-b0d3-d9593367705d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:30:55.638331 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-eb8a4681-5ba1-4a16-b0d3-d9593367705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:55.652470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b30bd-d734-4e0a-8b45-ba86d6bec7b9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:55.661350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1273/2507] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:30:55.665206 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b30bd-d734-4e0a-8b45-ba86d6bec7b9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:55.671422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18da89-a0bb-4052-9429-205e12a9da28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:55.673244 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18da89-a0bb-4052-9429-205e12a9da28 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:55.673535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18da89-a0bb-4052-9429-205e12a9da28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:55.673835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18da89-a0bb-4052-9429-205e12a9da28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:55.674553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18da89-a0bb-4052-9429-205e12a9da28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:30:55.674856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18da89-a0bb-4052-9429-205e12a9da28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:55.676534 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18da89-a0bb-4052-9429-205e12a9da28 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:55.693365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1235/2508] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:30:55.697468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a4681-5ba1-4a16-b0d3-d9593367705d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:55.710782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a4681-5ba1-4a16-b0d3-d9593367705d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:55.716121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6444d95-701d-4a60-975d-8c951eefe66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:55.719568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6444d95-701d-4a60-975d-8c951eefe66e admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:55.719897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6444d95-701d-4a60-975d-8c951eefe66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:55.720540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6444d95-701d-4a60-975d-8c951eefe66e admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:55.721694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6444d95-701d-4a60-975d-8c951eefe66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:55.723652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6444d95-701d-4a60-975d-8c951eefe66e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:55.833208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1274/2509] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:30:55 2022] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:30:55.834073 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18da89-a0bb-4052-9429-205e12a9da28 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:55.850191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18da89-a0bb-4052-9429-205e12a9da28 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:55.887745 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:30:55.939835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5812f-1b02-4711-9777-0aa476027f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:55.940650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5812f-1b02-4711-9777-0aa476027f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:55.941019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5812f-1b02-4711-9777-0aa476027f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:55.941559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5812f-1b02-4711-9777-0aa476027f05 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:55.942324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5812f-1b02-4711-9777-0aa476027f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:55.957631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5812f-1b02-4711-9777-0aa476027f05 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:56.089583 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1236/2510] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:30:55 2022] POST /identity/v3/users => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:30:56.094069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6444d95-701d-4a60-975d-8c951eefe66e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:56.099923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:30:56.107113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6444d95-701d-4a60-975d-8c951eefe66e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:56.112103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77736e91-fb6d-46ca-85ca-294a4e096022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:56.112821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77736e91-fb6d-46ca-85ca-294a4e096022 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:56.113224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77736e91-fb6d-46ca-85ca-294a4e096022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:56.113421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77736e91-fb6d-46ca-85ca-294a4e096022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:56.114055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77736e91-fb6d-46ca-85ca-294a4e096022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:56.115724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77736e91-fb6d-46ca-85ca-294a4e096022 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:56.128354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1275/2511] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:30:56.132654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5812f-1b02-4711-9777-0aa476027f05 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:56.148079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5812f-1b02-4711-9777-0aa476027f05 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:56.155897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0c92d-9ef1-4f44-b0db-58b3085d09fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:56.157067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c92d-9ef1-4f44-b0db-58b3085d09fc admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:56.161160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c92d-9ef1-4f44-b0db-58b3085d09fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:56.161160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c92d-9ef1-4f44-b0db-58b3085d09fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:56.161160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0c92d-9ef1-4f44-b0db-58b3085d09fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:56.161160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0c92d-9ef1-4f44-b0db-58b3085d09fc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:56.175414 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1237/2512] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:30:56.180197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77736e91-fb6d-46ca-85ca-294a4e096022 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:56.191594 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77736e91-fb6d-46ca-85ca-294a4e096022 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:56.196771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26960-d5ca-429f-a1ed-d68ad9c699e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:56.197876 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26960-d5ca-429f-a1ed-d68ad9c699e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:56.197998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26960-d5ca-429f-a1ed-d68ad9c699e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:56.198242 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26960-d5ca-429f-a1ed-d68ad9c699e8 admin admin] PATH_INFO: `/v3/projects/69797bf576c74fab8a0492f34d685f35/users/32542a35f72841e7915c9d15a09d1cc5/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:56.222711 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26960-d5ca-429f-a1ed-d68ad9c699e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69797bf576c74fab8a0492f34d685f35, user_id=32542a35f72841e7915c9d15a09d1cc5, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:56.225507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26960-d5ca-429f-a1ed-d68ad9c699e8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:56.277121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1276/2513] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:30:56 2022] PUT /identity/v3/projects/69797bf576c74fab8a0492f34d685f35/users/32542a35f72841e7915c9d15a09d1cc5/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:30:56.283372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e4d59-e6ed-4d99-89e2-847217f0e0c2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:56.287504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e4d59-e6ed-4d99-89e2-847217f0e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:56.287504 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e4d59-e6ed-4d99-89e2-847217f0e0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:56.311001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fb6e4d59-e6ed-4d99-89e2-847217f0e0c2 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:30:56.312457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fb6e4d59-e6ed-4d99-89e2-847217f0e0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:56.395331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1238/2514] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:30:56.402291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26960-d5ca-429f-a1ed-d68ad9c699e8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:56.405068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a8f26960-d5ca-429f-a1ed-d68ad9c699e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:56.470845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26960-d5ca-429f-a1ed-d68ad9c699e8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:56.474872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a517c-7512-4fa5-9492-df2d64496595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:56.475524 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a517c-7512-4fa5-9492-df2d64496595 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:56.475807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a517c-7512-4fa5-9492-df2d64496595 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:56.476084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a517c-7512-4fa5-9492-df2d64496595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:56.486075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a517c-7512-4fa5-9492-df2d64496595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:56.487810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a517c-7512-4fa5-9492-df2d64496595 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:56.499383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1277/2515] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:30:58.184523 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c4332-f4c9-44e7-a393-f1492cf2d499 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:58.185976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c4332-f4c9-44e7-a393-f1492cf2d499 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:58.186562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c4332-f4c9-44e7-a393-f1492cf2d499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:58.226199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-416c4332-f4c9-44e7-a393-f1492cf2d499 None None] MFA Rules not processed for user `32542a35f72841e7915c9d15a09d1cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:30:58.226199 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-416c4332-f4c9-44e7-a393-f1492cf2d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:30:58.356131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1239/2516] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:30:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:30:58.356884 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a517c-7512-4fa5-9492-df2d64496595 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:58.372810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a517c-7512-4fa5-9492-df2d64496595 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:58.379395 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc92b4-0d4d-4b97-ad09-fadfc47db749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:58.380064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc92b4-0d4d-4b97-ad09-fadfc47db749 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:58.380414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc92b4-0d4d-4b97-ad09-fadfc47db749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:58.380689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc92b4-0d4d-4b97-ad09-fadfc47db749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:58.381381 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc92b4-0d4d-4b97-ad09-fadfc47db749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:58.383285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc92b4-0d4d-4b97-ad09-fadfc47db749 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:58.482111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c4332-f4c9-44e7-a393-f1492cf2d499 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:58.491241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1278/2517] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:30:58 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:30:58.494833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c4332-f4c9-44e7-a393-f1492cf2d499 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:58.528831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:30:58.563640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e347d8-2fc0-4dc9-ba17-c11874ab363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:58.564440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e347d8-2fc0-4dc9-ba17-c11874ab363a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:58.564774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e347d8-2fc0-4dc9-ba17-c11874ab363a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:58.572453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e347d8-2fc0-4dc9-ba17-c11874ab363a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:58.572453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e347d8-2fc0-4dc9-ba17-c11874ab363a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:58.572453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e347d8-2fc0-4dc9-ba17-c11874ab363a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:58.711564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1240/2518] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:30:58 2022] POST /identity/v3/users => generated 309 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:30:58.715444 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc92b4-0d4d-4b97-ad09-fadfc47db749 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:58.728595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc92b4-0d4d-4b97-ad09-fadfc47db749 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:58.733946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe940dd-785f-4205-b6df-dc5b77f80d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:58.735867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe940dd-785f-4205-b6df-dc5b77f80d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:58.735867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe940dd-785f-4205-b6df-dc5b77f80d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:58.735867 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe940dd-785f-4205-b6df-dc5b77f80d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:58.736282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe940dd-785f-4205-b6df-dc5b77f80d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:58.738022 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe940dd-785f-4205-b6df-dc5b77f80d40 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:58.753208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1279/2519] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:30:58.754502 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e347d8-2fc0-4dc9-ba17-c11874ab363a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:58.766284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e347d8-2fc0-4dc9-ba17-c11874ab363a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:58.771594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a30256-c198-4a6e-9069-cdfeb00bd472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:58.772589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a30256-c198-4a6e-9069-cdfeb00bd472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:58.772979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a30256-c198-4a6e-9069-cdfeb00bd472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:58.773321 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a30256-c198-4a6e-9069-cdfeb00bd472 admin admin] PATH_INFO: `/v3/projects/8f4902d482ae47c0bc71fe055bfeb7e9/users/60d02c2c1f7b420bbd531aa09821c584/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:58.799966 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a30256-c198-4a6e-9069-cdfeb00bd472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4902d482ae47c0bc71fe055bfeb7e9, user_id=60d02c2c1f7b420bbd531aa09821c584, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:58.799966 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a30256-c198-4a6e-9069-cdfeb00bd472 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:58.870412 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1241/2520] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:30:58 2022] PUT /identity/v3/projects/8f4902d482ae47c0bc71fe055bfeb7e9/users/60d02c2c1f7b420bbd531aa09821c584/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:30:58.874304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe940dd-785f-4205-b6df-dc5b77f80d40 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:58.886540 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe940dd-785f-4205-b6df-dc5b77f80d40 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:58.955226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f23182-fbad-412c-be44-bd115e8b18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:58.956203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f23182-fbad-412c-be44-bd115e8b18ed admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:58.956531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f23182-fbad-412c-be44-bd115e8b18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:58.956899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f23182-fbad-412c-be44-bd115e8b18ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:58.957518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f23182-fbad-412c-be44-bd115e8b18ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:58.959168 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f23182-fbad-412c-be44-bd115e8b18ed admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:58.974659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a30256-c198-4a6e-9069-cdfeb00bd472 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:30:58.980221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1280/2521] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:30:58.989492 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a30256-c198-4a6e-9069-cdfeb00bd472 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:30:58.994612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb4a0d-ec9d-45fe-bdc1-e342489210e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:30:58.995597 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb4a0d-ec9d-45fe-bdc1-e342489210e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:30:58.995964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb4a0d-ec9d-45fe-bdc1-e342489210e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:30:58.996329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb4a0d-ec9d-45fe-bdc1-e342489210e2 admin admin] PATH_INFO: `/v3/projects/8f4902d482ae47c0bc71fe055bfeb7e9/users/60d02c2c1f7b420bbd531aa09821c584/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:30:58.998475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb4a0d-ec9d-45fe-bdc1-e342489210e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4902d482ae47c0bc71fe055bfeb7e9, user_id=60d02c2c1f7b420bbd531aa09821c584, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:30:59.001403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb4a0d-ec9d-45fe-bdc1-e342489210e2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:30:59.014767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1242/2522] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:30:58 2022] PUT /identity/v3/projects/8f4902d482ae47c0bc71fe055bfeb7e9/users/60d02c2c1f7b420bbd531aa09821c584/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:00.672526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c374-b60f-4306-8588-947d2557a593 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:00.672957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c374-b60f-4306-8588-947d2557a593 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:00.673387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41c374-b60f-4306-8588-947d2557a593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:00.732877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2e41c374-b60f-4306-8588-947d2557a593 None None] MFA Rules not processed for user `60d02c2c1f7b420bbd531aa09821c584`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:00.734397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2e41c374-b60f-4306-8588-947d2557a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:00.771222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:00.865504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1281/2523] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:02.166886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb4a0d-ec9d-45fe-bdc1-e342489210e2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:02.232952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb4a0d-ec9d-45fe-bdc1-e342489210e2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:02.237975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:02.238844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:02.239189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:02.239513 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] PATH_INFO: `/v3/users/32542a35f72841e7915c9d15a09d1cc5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:02.240756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32542a35f72841e7915c9d15a09d1cc5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:02.242680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:02.386175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32542a35f72841e7915c9d15a09d1cc5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:02.393366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32542a35f72841e7915c9d15a09d1cc5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:02.394050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32542a35f72841e7915c9d15a09d1cc5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:02.407271 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32542a35f72841e7915c9d15a09d1cc5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:02.473776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32542a35f72841e7915c9d15a09d1cc5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:02.480338 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1243/2524] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:31:02 2022] DELETE /identity/v3/users/32542a35f72841e7915c9d15a09d1cc5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:02.749868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41c374-b60f-4306-8588-947d2557a593 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:02.761627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41c374-b60f-4306-8588-947d2557a593 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:02.822435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:02.823304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:02.823585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:02.823882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] PATH_INFO: `/v3/projects/69797bf576c74fab8a0492f34d685f35` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:02.825073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] RBAC: Authorizing `identity:delete_project(project_id=69797bf576c74fab8a0492f34d685f35)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:02.827509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:02.943393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69797bf576c74fab8a0492f34d685f35', 'request_id': 'req-09302586-a9a3-436a-9977-f74c9f0f640a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.027930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69797bf576c74fab8a0492f34d685f35', 'request_id': 'req-09302586-a9a3-436a-9977-f74c9f0f640a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.034666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69797bf576c74fab8a0492f34d685f35', 'request_id': 'req-09302586-a9a3-436a-9977-f74c9f0f640a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.045900 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] The token cache is being invalidate because project 69797bf576c74fab8a0492f34d685f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:31:03.046220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.046853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.048404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1282/2525] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:31:02 2022] DELETE /identity/v3/projects/69797bf576c74fab8a0492f34d685f35 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:03.052551 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:03.053967 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:03.062326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:03.067430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3dff8-32d8-421d-bd3a-009d8cfa693e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:03.121839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:03.122703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:03.122979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:03.123255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] PATH_INFO: `/v3/users/60d02c2c1f7b420bbd531aa09821c584` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:03.124473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d02c2c1f7b420bbd531aa09821c584)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:03.126488 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:03.288008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d02c2c1f7b420bbd531aa09821c584'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.295353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d02c2c1f7b420bbd531aa09821c584'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.296048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d02c2c1f7b420bbd531aa09821c584'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.308453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d02c2c1f7b420bbd531aa09821c584'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.410740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-54dddabf-8910-465a-9e04-11001ef876fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d02c2c1f7b420bbd531aa09821c584'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.417036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1244/2526] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:31:03 2022] DELETE /identity/v3/users/60d02c2c1f7b420bbd531aa09821c584 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:03.699209 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:03.700720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:03.716304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09302586-a9a3-436a-9977-f74c9f0f640a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:03.762548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:03.773925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:03.774800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:03.775084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:03.775361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] PATH_INFO: `/v3/projects/8f4902d482ae47c0bc71fe055bfeb7e9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:03.776597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4902d482ae47c0bc71fe055bfeb7e9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:03.778507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:03.902424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4902d482ae47c0bc71fe055bfeb7e9', 'request_id': 'req-9bd474e9-54d2-4250-af89-49ed44c4b2ce'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.970414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4902d482ae47c0bc71fe055bfeb7e9', 'request_id': 'req-9bd474e9-54d2-4250-af89-49ed44c4b2ce'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.976132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4902d482ae47c0bc71fe055bfeb7e9', 'request_id': 'req-9bd474e9-54d2-4250-af89-49ed44c4b2ce'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.987843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] The token cache is being invalidate because project 8f4902d482ae47c0bc71fe055bfeb7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:31:03.988913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.988913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bd474e9-54d2-4250-af89-49ed44c4b2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:03.990334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1283/2527] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:31:03 2022] DELETE /identity/v3/projects/8f4902d482ae47c0bc71fe055bfeb7e9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:03.995247 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168bcbc-02ff-436e-8d2a-09503a0577e1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:03.995539 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168bcbc-02ff-436e-8d2a-09503a0577e1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:03.995817 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168bcbc-02ff-436e-8d2a-09503a0577e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.013969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b168bcbc-02ff-436e-8d2a-09503a0577e1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:04.016044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b168bcbc-02ff-436e-8d2a-09503a0577e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:04.073921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1245/2528] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:04.081672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc904c69-2e6c-4000-8c6e-d331119671ff None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.081962 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc904c69-2e6c-4000-8c6e-d331119671ff None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.082241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc904c69-2e6c-4000-8c6e-d331119671ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.100598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bc904c69-2e6c-4000-8c6e-d331119671ff None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:04.101795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bc904c69-2e6c-4000-8c6e-d331119671ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:04.110362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1284/2529] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:31:04.114306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168bcbc-02ff-436e-8d2a-09503a0577e1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.123848 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168bcbc-02ff-436e-8d2a-09503a0577e1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:04.128333 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520648c-997b-4a69-9be9-613440bdaf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:04.128998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520648c-997b-4a69-9be9-613440bdaf29 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.129283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520648c-997b-4a69-9be9-613440bdaf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.129559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520648c-997b-4a69-9be9-613440bdaf29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.130282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520648c-997b-4a69-9be9-613440bdaf29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:31:04.130588 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520648c-997b-4a69-9be9-613440bdaf29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:04.132193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520648c-997b-4a69-9be9-613440bdaf29 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:04.143753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1246/2530] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:31:04.147533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc904c69-2e6c-4000-8c6e-d331119671ff None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.158163 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc904c69-2e6c-4000-8c6e-d331119671ff None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:04.162818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0336fc0-73aa-43e4-beaa-7747a25b0975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:04.163458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336fc0-73aa-43e4-beaa-7747a25b0975 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.163738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336fc0-73aa-43e4-beaa-7747a25b0975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.164052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336fc0-73aa-43e4-beaa-7747a25b0975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.164762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0336fc0-73aa-43e4-beaa-7747a25b0975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:04.166953 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0336fc0-73aa-43e4-beaa-7747a25b0975 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:04.248176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1285/2531] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:31:04 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:04.252209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520648c-997b-4a69-9be9-613440bdaf29 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.262463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520648c-997b-4a69-9be9-613440bdaf29 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:04.266640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0336fc0-73aa-43e4-beaa-7747a25b0975 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.267829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:04.268260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f0336fc0-73aa-43e4-beaa-7747a25b0975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:04.322532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfe57b-dfdd-41db-8419-57753cfc30d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:04.324148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfe57b-dfdd-41db-8419-57753cfc30d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.324148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfe57b-dfdd-41db-8419-57753cfc30d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.324148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfe57b-dfdd-41db-8419-57753cfc30d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.324846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfe57b-dfdd-41db-8419-57753cfc30d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:04.326831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfe57b-dfdd-41db-8419-57753cfc30d8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:04.343754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0336fc0-73aa-43e4-beaa-7747a25b0975 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:04.349851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8845e63-49d2-4a4f-973e-0ccb3d468fa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:04.350563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8845e63-49d2-4a4f-973e-0ccb3d468fa9 service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.350853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8845e63-49d2-4a4f-973e-0ccb3d468fa9 service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.351136 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8845e63-49d2-4a4f-973e-0ccb3d468fa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.352957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b8845e63-49d2-4a4f-973e-0ccb3d468fa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:04.365559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8845e63-49d2-4a4f-973e-0ccb3d468fa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:04.367149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8845e63-49d2-4a4f-973e-0ccb3d468fa9 service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:04.377952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1286/2532] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:31:04.415884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1247/2533] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:31:04 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:04.417436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8845e63-49d2-4a4f-973e-0ccb3d468fa9 service placement] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.428377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8845e63-49d2-4a4f-973e-0ccb3d468fa9 service placement] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:04.433172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577f631-fcc4-4255-83c7-94aad7f1b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:04.433833 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577f631-fcc4-4255-83c7-94aad7f1b582 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.434122 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577f631-fcc4-4255-83c7-94aad7f1b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.434401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577f631-fcc4-4255-83c7-94aad7f1b582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.435120 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577f631-fcc4-4255-83c7-94aad7f1b582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:04.437019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577f631-fcc4-4255-83c7-94aad7f1b582 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:04.450562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1287/2534] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:04.452463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfe57b-dfdd-41db-8419-57753cfc30d8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.462940 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfe57b-dfdd-41db-8419-57753cfc30d8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:04.467846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd7dd7-ffba-4c73-8c24-a665f69b1e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:04.468555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd7dd7-ffba-4c73-8c24-a665f69b1e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.468859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd7dd7-ffba-4c73-8c24-a665f69b1e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.469149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd7dd7-ffba-4c73-8c24-a665f69b1e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.469878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd7dd7-ffba-4c73-8c24-a665f69b1e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:04.471572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd7dd7-ffba-4c73-8c24-a665f69b1e35 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:04.481882 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1248/2535] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:04.486258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577f631-fcc4-4255-83c7-94aad7f1b582 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.496154 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577f631-fcc4-4255-83c7-94aad7f1b582 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:04.501682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfb964-6bef-46e1-b6df-c6161478401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:04.502564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfb964-6bef-46e1-b6df-c6161478401b admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.502975 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfb964-6bef-46e1-b6df-c6161478401b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.503244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfb964-6bef-46e1-b6df-c6161478401b admin admin] PATH_INFO: `/v3/projects/5eaf4f966f654836a5056d5cef5692e2/users/cb52407c9fc74e168f7195acff326f9e/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.520525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfb964-6bef-46e1-b6df-c6161478401b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eaf4f966f654836a5056d5cef5692e2, user_id=cb52407c9fc74e168f7195acff326f9e, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:04.523889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfb964-6bef-46e1-b6df-c6161478401b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:04.579792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1288/2536] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:31:04 2022] PUT /identity/v3/projects/5eaf4f966f654836a5056d5cef5692e2/users/cb52407c9fc74e168f7195acff326f9e/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:04.589391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78de8f-4188-4e77-8788-41f2fa30f2b8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.589684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78de8f-4188-4e77-8788-41f2fa30f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.589964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78de8f-4188-4e77-8788-41f2fa30f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.621662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2a78de8f-4188-4e77-8788-41f2fa30f2b8 None None] MFA Rules not processed for user `cb52407c9fc74e168f7195acff326f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:04.622991 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2a78de8f-4188-4e77-8788-41f2fa30f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:04.695782 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1249/2537] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:04.700255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfb964-6bef-46e1-b6df-c6161478401b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.706225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:04.764384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfb964-6bef-46e1-b6df-c6161478401b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:04.772252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affa210-a08c-4c84-9a56-03369a1d516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:04.773580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affa210-a08c-4c84-9a56-03369a1d516d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.773580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affa210-a08c-4c84-9a56-03369a1d516d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.773580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affa210-a08c-4c84-9a56-03369a1d516d admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.774221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affa210-a08c-4c84-9a56-03369a1d516d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:04.776198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affa210-a08c-4c84-9a56-03369a1d516d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:04.856626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1289/2538] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:31:04 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:04.857751 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78de8f-4188-4e77-8788-41f2fa30f2b8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.869093 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78de8f-4188-4e77-8788-41f2fa30f2b8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:04.923988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10990fe1-ff44-4704-a790-c4ca8e4a9a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:04.924687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10990fe1-ff44-4704-a790-c4ca8e4a9a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:04.924973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10990fe1-ff44-4704-a790-c4ca8e4a9a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:04.925250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10990fe1-ff44-4704-a790-c4ca8e4a9a66 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:04.925929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10990fe1-ff44-4704-a790-c4ca8e4a9a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:04.927879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10990fe1-ff44-4704-a790-c4ca8e4a9a66 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:04.982908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1250/2539] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:31:04 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:04.987466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affa210-a08c-4c84-9a56-03369a1d516d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:04.997976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affa210-a08c-4c84-9a56-03369a1d516d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:05.003175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b8b4-aff2-4360-b75a-e480598dfec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:05.003851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b8b4-aff2-4360-b75a-e480598dfec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:05.004137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b8b4-aff2-4360-b75a-e480598dfec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:05.004456 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b8b4-aff2-4360-b75a-e480598dfec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:05.005173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6b8b4-aff2-4360-b75a-e480598dfec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:05.006765 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6b8b4-aff2-4360-b75a-e480598dfec0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:05.017260 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1290/2540] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:05.021403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10990fe1-ff44-4704-a790-c4ca8e4a9a66 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:05.031645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10990fe1-ff44-4704-a790-c4ca8e4a9a66 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:05.036187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f603233-0976-4c5a-8fdc-4c34ed35543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:05.037086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f603233-0976-4c5a-8fdc-4c34ed35543c admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:05.037369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f603233-0976-4c5a-8fdc-4c34ed35543c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:05.037735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f603233-0976-4c5a-8fdc-4c34ed35543c admin admin] PATH_INFO: `/v3/projects/66a8e0b412484a09960418e185583c8b/users/15733fd6e8c541cbb191dfbee25feeb3/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:05.039897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:05.053037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f603233-0976-4c5a-8fdc-4c34ed35543c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a8e0b412484a09960418e185583c8b, user_id=15733fd6e8c541cbb191dfbee25feeb3, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:05.056132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f603233-0976-4c5a-8fdc-4c34ed35543c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:05.114612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1251/2541] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:31:05 2022] PUT /identity/v3/projects/66a8e0b412484a09960418e185583c8b/users/15733fd6e8c541cbb191dfbee25feeb3/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:05.118614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b8b4-aff2-4360-b75a-e480598dfec0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:05.129445 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b8b4-aff2-4360-b75a-e480598dfec0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:05.183404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59f704-eeda-4906-91fe-a869302cf94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:05.184063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59f704-eeda-4906-91fe-a869302cf94e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:05.184378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59f704-eeda-4906-91fe-a869302cf94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:05.184661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59f704-eeda-4906-91fe-a869302cf94e admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:05.185656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59f704-eeda-4906-91fe-a869302cf94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:05.187244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59f704-eeda-4906-91fe-a869302cf94e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:05.198281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1291/2542] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:05.202106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f603233-0976-4c5a-8fdc-4c34ed35543c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:05.212623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f603233-0976-4c5a-8fdc-4c34ed35543c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:05.217396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff9ed4-bcb2-4c85-babe-8aa42c77e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:05.218275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff9ed4-bcb2-4c85-babe-8aa42c77e36c admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:05.218555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff9ed4-bcb2-4c85-babe-8aa42c77e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:05.218827 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff9ed4-bcb2-4c85-babe-8aa42c77e36c admin admin] PATH_INFO: `/v3/projects/66a8e0b412484a09960418e185583c8b/users/15733fd6e8c541cbb191dfbee25feeb3/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:05.220913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff9ed4-bcb2-4c85-babe-8aa42c77e36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a8e0b412484a09960418e185583c8b, user_id=15733fd6e8c541cbb191dfbee25feeb3, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:05.223566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff9ed4-bcb2-4c85-babe-8aa42c77e36c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:05.233831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1252/2543] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:31:05 2022] PUT /identity/v3/projects/66a8e0b412484a09960418e185583c8b/users/15733fd6e8c541cbb191dfbee25feeb3/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:05.245669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563c880-b6cc-47fe-8ce9-f32c8a2c5989 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:05.245977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563c880-b6cc-47fe-8ce9-f32c8a2c5989 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:05.246257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563c880-b6cc-47fe-8ce9-f32c8a2c5989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:05.272521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1563c880-b6cc-47fe-8ce9-f32c8a2c5989 None None] MFA Rules not processed for user `15733fd6e8c541cbb191dfbee25feeb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:05.273714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1563c880-b6cc-47fe-8ce9-f32c8a2c5989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:05.339160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:05.342729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1292/2544] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:05.353880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff9ed4-bcb2-4c85-babe-8aa42c77e36c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:05.355578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cdff9ed4-bcb2-4c85-babe-8aa42c77e36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:05.412354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff9ed4-bcb2-4c85-babe-8aa42c77e36c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:05.415927 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e6394-b958-48eb-8f2b-dcc70308f9f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:05.416603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e6394-b958-48eb-8f2b-dcc70308f9f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:05.416890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e6394-b958-48eb-8f2b-dcc70308f9f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:05.417170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e6394-b958-48eb-8f2b-dcc70308f9f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:05.426667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e6394-b958-48eb-8f2b-dcc70308f9f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:05.428109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e6394-b958-48eb-8f2b-dcc70308f9f6 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:05.437906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1253/2545] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:31:05.653787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563c880-b6cc-47fe-8ce9-f32c8a2c5989 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:05.664149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563c880-b6cc-47fe-8ce9-f32c8a2c5989 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:05.667889 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8950-3240-4dc9-8dfa-aef9081cad25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:05.668595 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8950-3240-4dc9-8dfa-aef9081cad25 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:05.668913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8950-3240-4dc9-8dfa-aef9081cad25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:05.669216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8950-3240-4dc9-8dfa-aef9081cad25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:05.727969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d8950-3240-4dc9-8dfa-aef9081cad25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:05.729426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d8950-3240-4dc9-8dfa-aef9081cad25 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:05.739327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1293/2546] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:31:07.988137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78629a5-4fd7-41f4-a993-0fd07bd40a22 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:07.988137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78629a5-4fd7-41f4-a993-0fd07bd40a22 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:07.988137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78629a5-4fd7-41f4-a993-0fd07bd40a22 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:07.988137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1254/2547] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:31:07.989086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9c501-c9dd-4f48-b81f-86d5ce66228a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:07.989086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9c501-c9dd-4f48-b81f-86d5ce66228a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:07.989086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9c501-c9dd-4f48-b81f-86d5ce66228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:07.989086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d4b9c501-c9dd-4f48-b81f-86d5ce66228a None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:07.989086 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d4b9c501-c9dd-4f48-b81f-86d5ce66228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:08.004276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1294/2548] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:08.016056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78629a5-4fd7-41f4-a993-0fd07bd40a22 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:08.017781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b78629a5-4fd7-41f4-a993-0fd07bd40a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:08.079558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78629a5-4fd7-41f4-a993-0fd07bd40a22 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:08.083148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5451612-b449-40cf-9e1b-02ef4111d843 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b95fdb06a94c1586148df32413085f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:08.083960 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451612-b449-40cf-9e1b-02ef4111d843 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:08.084327 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451612-b449-40cf-9e1b-02ef4111d843 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:08.089417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451612-b449-40cf-9e1b-02ef4111d843 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:08.095096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5451612-b449-40cf-9e1b-02ef4111d843 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:08.096704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5451612-b449-40cf-9e1b-02ef4111d843 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:08.108450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1255/2549] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:31:08.327722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f40571-db31-49ad-a73d-22bcd900ef3e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:08.328041 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f40571-db31-49ad-a73d-22bcd900ef3e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:08.328333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f40571-db31-49ad-a73d-22bcd900ef3e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:08.329737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1295/2550] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:31:08.334366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a52aed-447d-410e-bc4c-3b77af1ee112 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:08.337531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a52aed-447d-410e-bc4c-3b77af1ee112 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:08.337531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a52aed-447d-410e-bc4c-3b77af1ee112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:08.352709 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-54a52aed-447d-410e-bc4c-3b77af1ee112 None None] MFA Rules not processed for user `e22fe8105f01400ab6ac3dc14c7aa7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:08.354267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-54a52aed-447d-410e-bc4c-3b77af1ee112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:08.404972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1256/2551] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:31:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:31:08.417068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f40571-db31-49ad-a73d-22bcd900ef3e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:08.418778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d1f40571-db31-49ad-a73d-22bcd900ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:08.432706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f40571-db31-49ad-a73d-22bcd900ef3e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:08.436724 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f0b88-b896-4490-890b-d9571c54b577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:08.437360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f0b88-b896-4490-890b-d9571c54b577 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:08.437641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f0b88-b896-4490-890b-d9571c54b577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:08.437955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f0b88-b896-4490-890b-d9571c54b577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:08.445012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f0b88-b896-4490-890b-d9571c54b577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:08.446431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f0b88-b896-4490-890b-d9571c54b577 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:08.454207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1296/2552] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:31:09.544151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e8075-63d3-42be-8a37-a86a6adc3ec2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:09.544653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e8075-63d3-42be-8a37-a86a6adc3ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:09.544755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e8075-63d3-42be-8a37-a86a6adc3ec2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:09.546097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1257/2553] 10.222.0.15 () {54 vars in 921 bytes} [Thu May 26 03:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 03:31:09.553579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c0577-6c6c-4eaa-9c87-5da223c3e80c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:09.554034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c0577-6c6c-4eaa-9c87-5da223c3e80c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:09.554193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c0577-6c6c-4eaa-9c87-5da223c3e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:09.572656 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-610c0577-6c6c-4eaa-9c87-5da223c3e80c None None] MFA Rules not processed for user `51f966be1d764324b7695e1caf578291`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:09.573910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-610c0577-6c6c-4eaa-9c87-5da223c3e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:09.583646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1297/2554] 10.222.0.15 () {58 vars in 1018 bytes} [Thu May 26 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:09.594746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e8075-63d3-42be-8a37-a86a6adc3ec2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:09.605408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e8075-63d3-42be-8a37-a86a6adc3ec2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:09.608870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9695b-8919-49e7-88c1-14522ca7abeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:09.609499 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9695b-8919-49e7-88c1-14522ca7abeb service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:09.609780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9695b-8919-49e7-88c1-14522ca7abeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:09.610056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9695b-8919-49e7-88c1-14522ca7abeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:09.619836 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9695b-8919-49e7-88c1-14522ca7abeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:09.621864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9695b-8919-49e7-88c1-14522ca7abeb service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:09.631877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1258/2555] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:31:14.806289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a706bd-0ae3-4f58-810b-4abb4786d48d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:14.806813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a706bd-0ae3-4f58-810b-4abb4786d48d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:14.806813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a706bd-0ae3-4f58-810b-4abb4786d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:14.827785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-73a706bd-0ae3-4f58-810b-4abb4786d48d None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:14.829250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-73a706bd-0ae3-4f58-810b-4abb4786d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:14.921307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1298/2556] 10.222.0.15 () {58 vars in 1009 bytes} [Thu May 26 03:31:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:14.943998 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9695b-8919-49e7-88c1-14522ca7abeb service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:14.945892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-46d9695b-8919-49e7-88c1-14522ca7abeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:14.966329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:15.025569 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9695b-8919-49e7-88c1-14522ca7abeb service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:15.030713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afd892-264b-45f6-92bc-6fa4ee330617 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:15.031360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afd892-264b-45f6-92bc-6fa4ee330617 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:15.031647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afd892-264b-45f6-92bc-6fa4ee330617 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:15.031925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afd892-264b-45f6-92bc-6fa4ee330617 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:15.040531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afd892-264b-45f6-92bc-6fa4ee330617 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:15.042118 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afd892-264b-45f6-92bc-6fa4ee330617 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:15.050576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1259/2557] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:31:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:31:24.906874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=93 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:25.046822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=27 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:33.825536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410bf4a-1613-4c4e-986f-8ab405e76b20 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:33.826015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410bf4a-1613-4c4e-986f-8ab405e76b20 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:33.826171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410bf4a-1613-4c4e-986f-8ab405e76b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:33.843937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f410bf4a-1613-4c4e-986f-8ab405e76b20 None None] MFA Rules not processed for user `2fdd0ca923f844dc92d769f25f366d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:33.845208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f410bf4a-1613-4c4e-986f-8ab405e76b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:33.904819 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1299/2558] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:35.186152 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7188b67-8a05-4490-9e39-098c599352db None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:35.186615 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7188b67-8a05-4490-9e39-098c599352db None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:35.186733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7188b67-8a05-4490-9e39-098c599352db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:35.205384 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a7188b67-8a05-4490-9e39-098c599352db None None] MFA Rules not processed for user `c3df8c2dd7194952abaa8658bbacd56f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:35.206580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a7188b67-8a05-4490-9e39-098c599352db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:35.213714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1260/2559] 10.222.0.15 () {58 vars in 967 bytes} [Thu May 26 03:31:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:35.225812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410bf4a-1613-4c4e-986f-8ab405e76b20 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:35.237898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410bf4a-1613-4c4e-986f-8ab405e76b20 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:35.242795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711eda-5b2c-464d-bc93-d32045004898 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80bd57e333be4921b6270b54a1fac2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:35.243491 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711eda-5b2c-464d-bc93-d32045004898 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:35.243771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711eda-5b2c-464d-bc93-d32045004898 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:35.244179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711eda-5b2c-464d-bc93-d32045004898 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:35.254075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27711eda-5b2c-464d-bc93-d32045004898 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:35.255699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27711eda-5b2c-464d-bc93-d32045004898 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:35.263797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1300/2560] 10.222.0.15 () {60 vars in 1384 bytes} [Thu May 26 03:31:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 03:31:44.344864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7188b67-8a05-4490-9e39-098c599352db None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:44.426612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7188b67-8a05-4490-9e39-098c599352db None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:44.431337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:44.432202 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:44.432512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:44.432791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] PATH_INFO: `/v3/users/cb52407c9fc74e168f7195acff326f9e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:44.433965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb52407c9fc74e168f7195acff326f9e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:44.436151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:44.636132 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb52407c9fc74e168f7195acff326f9e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:44.643418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb52407c9fc74e168f7195acff326f9e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:44.644096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb52407c9fc74e168f7195acff326f9e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:44.655526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb52407c9fc74e168f7195acff326f9e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:44.725003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb52407c9fc74e168f7195acff326f9e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:44.731149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1261/2561] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:31:44 2022] DELETE /identity/v3/users/cb52407c9fc74e168f7195acff326f9e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:44.735695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f51f-54b1-4b47-bba0-6597746af844 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:44.736684 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f51f-54b1-4b47-bba0-6597746af844 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:44.740157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f51f-54b1-4b47-bba0-6597746af844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:44.755622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c555f51f-54b1-4b47-bba0-6597746af844 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:44.756861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c555f51f-54b1-4b47-bba0-6597746af844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:44.818349 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1301/2562] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:31:44.827897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:44.829319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:44.887593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c013d91-99b1-4381-a678-e68cc435815c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:44.894314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd609af-1617-4b05-9c7d-c8d8a4481296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:44.894314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd609af-1617-4b05-9c7d-c8d8a4481296 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:44.894314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd609af-1617-4b05-9c7d-c8d8a4481296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:44.894314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd609af-1617-4b05-9c7d-c8d8a4481296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:44.902068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd609af-1617-4b05-9c7d-c8d8a4481296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:44.903497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd609af-1617-4b05-9c7d-c8d8a4481296 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:44.913452 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1262/2563] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:31:45.367150 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f51f-54b1-4b47-bba0-6597746af844 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:45.368913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c555f51f-54b1-4b47-bba0-6597746af844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:45.389249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f51f-54b1-4b47-bba0-6597746af844 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:45.396344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:45.397263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:45.397555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:45.401480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] PATH_INFO: `/v3/projects/5eaf4f966f654836a5056d5cef5692e2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:45.401480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eaf4f966f654836a5056d5cef5692e2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:45.401480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:45.514203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eaf4f966f654836a5056d5cef5692e2', 'request_id': 'req-7ff6fc03-1219-4f25-a07f-d4e942f62acf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.581879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eaf4f966f654836a5056d5cef5692e2', 'request_id': 'req-7ff6fc03-1219-4f25-a07f-d4e942f62acf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.587761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eaf4f966f654836a5056d5cef5692e2', 'request_id': 'req-7ff6fc03-1219-4f25-a07f-d4e942f62acf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.599358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] The token cache is being invalidate because project 5eaf4f966f654836a5056d5cef5692e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:31:45.599644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.600272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.601825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1302/2564] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:31:45 2022] DELETE /identity/v3/projects/5eaf4f966f654836a5056d5cef5692e2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:45.605767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd609af-1617-4b05-9c7d-c8d8a4481296 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:45.615328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd609af-1617-4b05-9c7d-c8d8a4481296 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:45.626407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:45.671109 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:45.671909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:45.672195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:45.672510 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] PATH_INFO: `/v3/users/15733fd6e8c541cbb191dfbee25feeb3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:45.673688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15733fd6e8c541cbb191dfbee25feeb3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:45.675785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:45.834972 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15733fd6e8c541cbb191dfbee25feeb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.841787 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15733fd6e8c541cbb191dfbee25feeb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.842502 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15733fd6e8c541cbb191dfbee25feeb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.853944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15733fd6e8c541cbb191dfbee25feeb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.931326 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2eadf18b-dea3-4e1d-92b4-4e58ebb6f296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15733fd6e8c541cbb191dfbee25feeb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:45.937738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1263/2565] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:31:45 2022] DELETE /identity/v3/users/15733fd6e8c541cbb191dfbee25feeb3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:46.332216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:46.333691 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:46.348585 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6fc03-1219-4f25-a07f-d4e942f62acf admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:46.363039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:46.412016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:46.412982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:46.413265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:46.413544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] PATH_INFO: `/v3/projects/66a8e0b412484a09960418e185583c8b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:46.414739 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a8e0b412484a09960418e185583c8b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:46.416756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:46.504942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a8e0b412484a09960418e185583c8b', 'request_id': 'req-e7c64f6c-ede0-4bd9-be57-bca47f344951'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:46.582403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a8e0b412484a09960418e185583c8b', 'request_id': 'req-e7c64f6c-ede0-4bd9-be57-bca47f344951'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:46.588431 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a8e0b412484a09960418e185583c8b', 'request_id': 'req-e7c64f6c-ede0-4bd9-be57-bca47f344951'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:46.600142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] The token cache is being invalidate because project 66a8e0b412484a09960418e185583c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:31:46.600464 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:46.601101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e7c64f6c-ede0-4bd9-be57-bca47f344951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:46.602626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1303/2566] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:31:46 2022] DELETE /identity/v3/projects/66a8e0b412484a09960418e185583c8b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:46.607553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec00bc4-c32b-4eb8-a386-81dd954142a3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:46.608001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec00bc4-c32b-4eb8-a386-81dd954142a3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:46.608110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec00bc4-c32b-4eb8-a386-81dd954142a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:46.626755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-cec00bc4-c32b-4eb8-a386-81dd954142a3 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:46.628119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cec00bc4-c32b-4eb8-a386-81dd954142a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:46.685096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1264/2567] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:46.693278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c571f-0ce6-4162-97f4-97a92b02f159 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:46.693676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c571f-0ce6-4162-97f4-97a92b02f159 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:46.694147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c571f-0ce6-4162-97f4-97a92b02f159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:46.713842 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0c1c571f-0ce6-4162-97f4-97a92b02f159 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:46.715106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0c1c571f-0ce6-4162-97f4-97a92b02f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:46.723859 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1304/2568] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:46.728197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec00bc4-c32b-4eb8-a386-81dd954142a3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:46.738417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec00bc4-c32b-4eb8-a386-81dd954142a3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:46.742939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f9539-874b-4519-82a2-47cbdb17efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:46.743586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f9539-874b-4519-82a2-47cbdb17efab admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:46.743868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f9539-874b-4519-82a2-47cbdb17efab admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:46.744144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f9539-874b-4519-82a2-47cbdb17efab admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:46.744904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f9539-874b-4519-82a2-47cbdb17efab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:31:46.748289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f9539-874b-4519-82a2-47cbdb17efab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:46.748289 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f9539-874b-4519-82a2-47cbdb17efab admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:46.758234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1265/2569] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:31:46.762490 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c571f-0ce6-4162-97f4-97a92b02f159 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:46.771847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c571f-0ce6-4162-97f4-97a92b02f159 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:46.776633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fadc0-985a-4832-afb0-f7ba2499c06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:46.777301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fadc0-985a-4832-afb0-f7ba2499c06c admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:46.777587 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fadc0-985a-4832-afb0-f7ba2499c06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:46.777868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fadc0-985a-4832-afb0-f7ba2499c06c admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:46.778571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fadc0-985a-4832-afb0-f7ba2499c06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:46.780492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fadc0-985a-4832-afb0-f7ba2499c06c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:46.890687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1305/2570] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:31:46 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:46.891843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f9539-874b-4519-82a2-47cbdb17efab admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:46.902048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f9539-874b-4519-82a2-47cbdb17efab admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:46.920729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:46.958354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d45bc0-3f31-4b50-aaa2-99d27350cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:46.959008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d45bc0-3f31-4b50-aaa2-99d27350cd7f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:46.959288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d45bc0-3f31-4b50-aaa2-99d27350cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:46.959565 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d45bc0-3f31-4b50-aaa2-99d27350cd7f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:46.960251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d45bc0-3f31-4b50-aaa2-99d27350cd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:46.963226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d45bc0-3f31-4b50-aaa2-99d27350cd7f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.039785 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1266/2571] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:31:46 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:47.043358 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fadc0-985a-4832-afb0-f7ba2499c06c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:47.053776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fadc0-985a-4832-afb0-f7ba2499c06c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:47.059101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84256-794d-46aa-b559-502ac623f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:47.059101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84256-794d-46aa-b559-502ac623f774 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.059484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84256-794d-46aa-b559-502ac623f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.060024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e84256-794d-46aa-b559-502ac623f774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.060802 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e84256-794d-46aa-b559-502ac623f774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:47.062376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e84256-794d-46aa-b559-502ac623f774 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.072897 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1306/2572] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:47.076810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d45bc0-3f31-4b50-aaa2-99d27350cd7f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:47.087157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d45bc0-3f31-4b50-aaa2-99d27350cd7f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:47.091742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e5de0-6f97-4fab-b645-473fe090770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:47.092419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e5de0-6f97-4fab-b645-473fe090770c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.092705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e5de0-6f97-4fab-b645-473fe090770c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.092981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e5de0-6f97-4fab-b645-473fe090770c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.093693 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e5de0-6f97-4fab-b645-473fe090770c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:47.095288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e5de0-6f97-4fab-b645-473fe090770c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.107429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1267/2573] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:47.111568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84256-794d-46aa-b559-502ac623f774 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:47.121772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e84256-794d-46aa-b559-502ac623f774 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:47.126468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e72f-8847-4a48-9441-363f5fabb2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:47.127353 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e72f-8847-4a48-9441-363f5fabb2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.127639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e72f-8847-4a48-9441-363f5fabb2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.127916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e72f-8847-4a48-9441-363f5fabb2aa admin admin] PATH_INFO: `/v3/projects/f0dc79e9f12f494fbb86d98b9c371bb9/users/468551148daa42709f0a6aad0c101c15/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.152010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5e72f-8847-4a48-9441-363f5fabb2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0dc79e9f12f494fbb86d98b9c371bb9, user_id=468551148daa42709f0a6aad0c101c15, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:47.152010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5e72f-8847-4a48-9441-363f5fabb2aa admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.280717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1307/2574] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:31:47 2022] PUT /identity/v3/projects/f0dc79e9f12f494fbb86d98b9c371bb9/users/468551148daa42709f0a6aad0c101c15/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:47.292302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de926d-0fc9-4051-b3b8-025517e649be None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.292571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de926d-0fc9-4051-b3b8-025517e649be None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.292858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de926d-0fc9-4051-b3b8-025517e649be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.319484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a9de926d-0fc9-4051-b3b8-025517e649be None None] MFA Rules not processed for user `468551148daa42709f0a6aad0c101c15`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:47.320730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a9de926d-0fc9-4051-b3b8-025517e649be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:47.382136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1268/2575] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:31:47.386555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e72f-8847-4a48-9441-363f5fabb2aa admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:47.429268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:47.446063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e72f-8847-4a48-9441-363f5fabb2aa admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:47.450752 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b11636-8a83-4093-9704-a1ed2e295c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:47.451396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b11636-8a83-4093-9704-a1ed2e295c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.451677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b11636-8a83-4093-9704-a1ed2e295c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.451948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b11636-8a83-4093-9704-a1ed2e295c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.452663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b11636-8a83-4093-9704-a1ed2e295c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:47.454546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b11636-8a83-4093-9704-a1ed2e295c0b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.559210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1308/2576] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:31:47 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:47.560603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de926d-0fc9-4051-b3b8-025517e649be None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:47.572066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de926d-0fc9-4051-b3b8-025517e649be None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:47.632332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abac377-4969-417a-8c19-d16ded282fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:47.633003 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abac377-4969-417a-8c19-d16ded282fff admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.633291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abac377-4969-417a-8c19-d16ded282fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.633574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abac377-4969-417a-8c19-d16ded282fff admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.634268 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abac377-4969-417a-8c19-d16ded282fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:47.636238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abac377-4969-417a-8c19-d16ded282fff admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.711685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1269/2577] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:31:47 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:47.712868 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b11636-8a83-4093-9704-a1ed2e295c0b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:47.723250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b11636-8a83-4093-9704-a1ed2e295c0b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:47.727826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591787da-6e42-4f2b-b5df-a01fe60d194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:47.728515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591787da-6e42-4f2b-b5df-a01fe60d194e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.728799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591787da-6e42-4f2b-b5df-a01fe60d194e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.729075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591787da-6e42-4f2b-b5df-a01fe60d194e admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.729788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591787da-6e42-4f2b-b5df-a01fe60d194e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:47.731361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591787da-6e42-4f2b-b5df-a01fe60d194e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.743523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1309/2578] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:47.747631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abac377-4969-417a-8c19-d16ded282fff admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:47.758141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abac377-4969-417a-8c19-d16ded282fff admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:47.762983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b0e91-20d0-458e-80ab-cdbdb1816fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:47.763868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0e91-20d0-458e-80ab-cdbdb1816fef admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.764154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0e91-20d0-458e-80ab-cdbdb1816fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.764467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0e91-20d0-458e-80ab-cdbdb1816fef admin admin] PATH_INFO: `/v3/projects/6b503bc590b94a9da34ff18d429bca75/users/c5415748a8fe4b539b23c0a55d43b86d/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.779374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b0e91-20d0-458e-80ab-cdbdb1816fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b503bc590b94a9da34ff18d429bca75, user_id=c5415748a8fe4b539b23c0a55d43b86d, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:47.782085 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b0e91-20d0-458e-80ab-cdbdb1816fef admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.788147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:47.846020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1270/2579] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:31:47 2022] PUT /identity/v3/projects/6b503bc590b94a9da34ff18d429bca75/users/c5415748a8fe4b539b23c0a55d43b86d/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:47.850062 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591787da-6e42-4f2b-b5df-a01fe60d194e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:47.860486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591787da-6e42-4f2b-b5df-a01fe60d194e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:47.918345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54420467-913b-402c-93da-bef7774c8065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:47.919133 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420467-913b-402c-93da-bef7774c8065 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.919419 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420467-913b-402c-93da-bef7774c8065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.919694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420467-913b-402c-93da-bef7774c8065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.920476 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54420467-913b-402c-93da-bef7774c8065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:47.922115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54420467-913b-402c-93da-bef7774c8065 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.936503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1310/2580] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:47.937690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b0e91-20d0-458e-80ab-cdbdb1816fef admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:47.948792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b0e91-20d0-458e-80ab-cdbdb1816fef admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:47.953417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d480132-1972-448a-82b7-7098cb036c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:47.954291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d480132-1972-448a-82b7-7098cb036c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.954568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d480132-1972-448a-82b7-7098cb036c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.954840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d480132-1972-448a-82b7-7098cb036c32 admin admin] PATH_INFO: `/v3/projects/6b503bc590b94a9da34ff18d429bca75/users/c5415748a8fe4b539b23c0a55d43b86d/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:47.956821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d480132-1972-448a-82b7-7098cb036c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b503bc590b94a9da34ff18d429bca75, user_id=c5415748a8fe4b539b23c0a55d43b86d, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:47.959459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d480132-1972-448a-82b7-7098cb036c32 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:47.969981 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1271/2581] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:31:47 2022] PUT /identity/v3/projects/6b503bc590b94a9da34ff18d429bca75/users/c5415748a8fe4b539b23c0a55d43b86d/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:31:47.980456 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb73d4-ce9a-4887-a098-6726963f3b65 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:47.980757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb73d4-ce9a-4887-a098-6726963f3b65 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:47.981068 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb73d4-ce9a-4887-a098-6726963f3b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:48.009019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-64fb73d4-ce9a-4887-a098-6726963f3b65 None None] MFA Rules not processed for user `c5415748a8fe4b539b23c0a55d43b86d`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:48.010324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-64fb73d4-ce9a-4887-a098-6726963f3b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:48.078751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1311/2582] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:31:48.090078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d480132-1972-448a-82b7-7098cb036c32 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:48.091752 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8d480132-1972-448a-82b7-7098cb036c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:48.149426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d480132-1972-448a-82b7-7098cb036c32 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:48.153226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1532fc-e6e8-4267-8029-73d8c242b0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:48.153949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1532fc-e6e8-4267-8029-73d8c242b0bc service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:48.154234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1532fc-e6e8-4267-8029-73d8c242b0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:48.154514 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1532fc-e6e8-4267-8029-73d8c242b0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:48.164159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1532fc-e6e8-4267-8029-73d8c242b0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:48.165642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1532fc-e6e8-4267-8029-73d8c242b0bc service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:48.175751 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1272/2583] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:31:48.396357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb73d4-ce9a-4887-a098-6726963f3b65 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:48.406165 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb73d4-ce9a-4887-a098-6726963f3b65 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:48.410853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15ed1b-1461-4979-a869-249bcd367eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:48.411525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15ed1b-1461-4979-a869-249bcd367eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:48.411811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15ed1b-1461-4979-a869-249bcd367eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:48.412091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15ed1b-1461-4979-a869-249bcd367eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:48.446750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:48.470465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15ed1b-1461-4979-a869-249bcd367eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:48.472536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15ed1b-1461-4979-a869-249bcd367eb3 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:48.482364 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1312/2584] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:31:56.907544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1532fc-e6e8-4267-8029-73d8c242b0bc service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:56.968175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1532fc-e6e8-4267-8029-73d8c242b0bc service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:56.972744 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:56.973637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:56.973915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:56.974191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] PATH_INFO: `/v3/users/468551148daa42709f0a6aad0c101c15` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:56.975362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=468551148daa42709f0a6aad0c101c15)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:56.977336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:57.160416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468551148daa42709f0a6aad0c101c15'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:57.167153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468551148daa42709f0a6aad0c101c15'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:57.167815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468551148daa42709f0a6aad0c101c15'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:57.180113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468551148daa42709f0a6aad0c101c15'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:57.278067 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468551148daa42709f0a6aad0c101c15'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:57.284685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1273/2585] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:31:56 2022] DELETE /identity/v3/users/468551148daa42709f0a6aad0c101c15 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:57.289181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339449a-627f-47dc-8526-a34564ef8332 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:57.299516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339449a-627f-47dc-8526-a34564ef8332 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:57.299516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339449a-627f-47dc-8526-a34564ef8332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:57.307224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3339449a-627f-47dc-8526-a34564ef8332 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:57.308443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3339449a-627f-47dc-8526-a34564ef8332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:57.365818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1313/2586] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:57.375285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:57.376749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:57.383087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:57.433193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a62e9-b170-4ca7-b647-3da79b83e46a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:57.436974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e4570-d86b-44ce-a5e7-07dc01f98450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:57.437607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e4570-d86b-44ce-a5e7-07dc01f98450 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:57.437888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e4570-d86b-44ce-a5e7-07dc01f98450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:57.438223 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e4570-d86b-44ce-a5e7-07dc01f98450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:57.447433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e4570-d86b-44ce-a5e7-07dc01f98450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:57.449270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e4570-d86b-44ce-a5e7-07dc01f98450 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:57.458476 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1274/2587] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:31:57.846854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339449a-627f-47dc-8526-a34564ef8332 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:57.848290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3339449a-627f-47dc-8526-a34564ef8332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:57.861281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339449a-627f-47dc-8526-a34564ef8332 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:57.866040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:57.866971 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:57.867258 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:57.867536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] PATH_INFO: `/v3/projects/f0dc79e9f12f494fbb86d98b9c371bb9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:57.869513 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0dc79e9f12f494fbb86d98b9c371bb9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:57.871535 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:57.959806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0dc79e9f12f494fbb86d98b9c371bb9', 'request_id': 'req-24544f17-00b4-47e9-8302-6d53e9cd5543'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:57.999345 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0dc79e9f12f494fbb86d98b9c371bb9', 'request_id': 'req-24544f17-00b4-47e9-8302-6d53e9cd5543'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:58.005713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0dc79e9f12f494fbb86d98b9c371bb9', 'request_id': 'req-24544f17-00b4-47e9-8302-6d53e9cd5543'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:58.017674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] The token cache is being invalidate because project f0dc79e9f12f494fbb86d98b9c371bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:31:58.018177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:58.019504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:58.021172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1314/2588] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:31:57 2022] DELETE /identity/v3/projects/f0dc79e9f12f494fbb86d98b9c371bb9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:58.025137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e4570-d86b-44ce-a5e7-07dc01f98450 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:58.035397 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e4570-d86b-44ce-a5e7-07dc01f98450 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:58.090561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:58.091419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:58.091705 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:58.091978 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] PATH_INFO: `/v3/users/c5415748a8fe4b539b23c0a55d43b86d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:58.093179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5415748a8fe4b539b23c0a55d43b86d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:58.095116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:58.304576 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5415748a8fe4b539b23c0a55d43b86d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:58.311402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5415748a8fe4b539b23c0a55d43b86d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:58.312059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5415748a8fe4b539b23c0a55d43b86d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:58.324123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5415748a8fe4b539b23c0a55d43b86d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:58.422529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04a0d6d6-bd57-40c4-a1d8-df385f33fc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5415748a8fe4b539b23c0a55d43b86d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:58.429487 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1275/2589] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:31:58 2022] DELETE /identity/v3/users/c5415748a8fe4b539b23c0a55d43b86d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:58.881047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:58.882506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:58.898130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24544f17-00b4-47e9-8302-6d53e9cd5543 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:58.956660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:58.958046 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:58.958324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:58.958605 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] PATH_INFO: `/v3/projects/6b503bc590b94a9da34ff18d429bca75` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:58.959776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b503bc590b94a9da34ff18d429bca75)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:58.961708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:58.963170 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:59.061667 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b503bc590b94a9da34ff18d429bca75', 'request_id': 'req-3f03d5ea-7070-49d2-8acf-02a0a4906a75'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:59.153470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b503bc590b94a9da34ff18d429bca75', 'request_id': 'req-3f03d5ea-7070-49d2-8acf-02a0a4906a75'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:59.159231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b503bc590b94a9da34ff18d429bca75', 'request_id': 'req-3f03d5ea-7070-49d2-8acf-02a0a4906a75'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:59.171375 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] The token cache is being invalidate because project 6b503bc590b94a9da34ff18d429bca75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:31:59.174621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:59.174621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f03d5ea-7070-49d2-8acf-02a0a4906a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:31:59.174621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1315/2590] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:31:58 2022] DELETE /identity/v3/projects/6b503bc590b94a9da34ff18d429bca75 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:31:59.178703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037249b-1b50-44b5-a802-98151c5a3793 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.179221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037249b-1b50-44b5-a802-98151c5a3793 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.179325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037249b-1b50-44b5-a802-98151c5a3793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:59.198033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7037249b-1b50-44b5-a802-98151c5a3793 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:59.199241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7037249b-1b50-44b5-a802-98151c5a3793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:59.219843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:31:59.258737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1276/2591] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:59.266517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6efe4-f241-4176-90ea-c18ca551c64b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.266817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6efe4-f241-4176-90ea-c18ca551c64b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.267098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6efe4-f241-4176-90ea-c18ca551c64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:59.285668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-edc6efe4-f241-4176-90ea-c18ca551c64b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:59.286841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-edc6efe4-f241-4176-90ea-c18ca551c64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:59.294592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1316/2592] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:59.298610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037249b-1b50-44b5-a802-98151c5a3793 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:59.307984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037249b-1b50-44b5-a802-98151c5a3793 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:59.312851 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2b5b8-3faa-4bfe-adc7-8548153708bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:59.313754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2b5b8-3faa-4bfe-adc7-8548153708bc admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.314226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2b5b8-3faa-4bfe-adc7-8548153708bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.314833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2b5b8-3faa-4bfe-adc7-8548153708bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:59.315567 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2b5b8-3faa-4bfe-adc7-8548153708bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:31:59.315885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2b5b8-3faa-4bfe-adc7-8548153708bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:59.318115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2b5b8-3faa-4bfe-adc7-8548153708bc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:59.329571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1277/2593] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:31:59.334103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6efe4-f241-4176-90ea-c18ca551c64b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:59.343156 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6efe4-f241-4176-90ea-c18ca551c64b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:59.347873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4642903-e75d-4469-92ec-b252a8c1d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:59.348548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4642903-e75d-4469-92ec-b252a8c1d2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.348836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4642903-e75d-4469-92ec-b252a8c1d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.349117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4642903-e75d-4469-92ec-b252a8c1d2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:59.349809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4642903-e75d-4469-92ec-b252a8c1d2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:59.351726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4642903-e75d-4469-92ec-b252a8c1d2b1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:59.475433 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1317/2594] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:31:59 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:59.479261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2b5b8-3faa-4bfe-adc7-8548153708bc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:59.489408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2b5b8-3faa-4bfe-adc7-8548153708bc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:59.545448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25519e3a-2228-495c-8cfc-33547f2f8c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:59.546121 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25519e3a-2228-495c-8cfc-33547f2f8c20 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.546406 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25519e3a-2228-495c-8cfc-33547f2f8c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.546690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25519e3a-2228-495c-8cfc-33547f2f8c20 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:59.547386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25519e3a-2228-495c-8cfc-33547f2f8c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:59.549358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25519e3a-2228-495c-8cfc-33547f2f8c20 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:59.656730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1278/2595] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:31:59 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:31:59.660890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4642903-e75d-4469-92ec-b252a8c1d2b1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:59.671117 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4642903-e75d-4469-92ec-b252a8c1d2b1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:59.676280 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5586-a3ab-405e-8a56-24b0b6db6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:59.676970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5586-a3ab-405e-8a56-24b0b6db6534 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.677256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5586-a3ab-405e-8a56-24b0b6db6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.677533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5586-a3ab-405e-8a56-24b0b6db6534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:59.678249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b5586-a3ab-405e-8a56-24b0b6db6534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:59.679826 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b5586-a3ab-405e-8a56-24b0b6db6534 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:59.691383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1318/2596] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:59.695759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25519e3a-2228-495c-8cfc-33547f2f8c20 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:59.705672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25519e3a-2228-495c-8cfc-33547f2f8c20 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:59.710334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353f771-9930-4bfd-ac7d-abf584a14846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:59.710979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353f771-9930-4bfd-ac7d-abf584a14846 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.711263 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353f771-9930-4bfd-ac7d-abf584a14846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.711540 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353f771-9930-4bfd-ac7d-abf584a14846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:59.712258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353f771-9930-4bfd-ac7d-abf584a14846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:59.713886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353f771-9930-4bfd-ac7d-abf584a14846 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:59.723646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1279/2597] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:31:59.727813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5586-a3ab-405e-8a56-24b0b6db6534 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:59.737596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5586-a3ab-405e-8a56-24b0b6db6534 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:59.742710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a76bc-0b8a-425d-8701-98e5042f7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:59.743580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a76bc-0b8a-425d-8701-98e5042f7933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.743863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a76bc-0b8a-425d-8701-98e5042f7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.744143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a76bc-0b8a-425d-8701-98e5042f7933 admin admin] PATH_INFO: `/v3/projects/a0052bd776c746e5a224aa9f323f5f44/users/30a8f92ad6d94f74803dc5af46a6c4e2/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:59.758885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a76bc-0b8a-425d-8701-98e5042f7933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0052bd776c746e5a224aa9f323f5f44, user_id=30a8f92ad6d94f74803dc5af46a6c4e2, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:31:59.761575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a76bc-0b8a-425d-8701-98e5042f7933 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:31:59.827544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1319/2598] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:31:59 2022] PUT /identity/v3/projects/a0052bd776c746e5a224aa9f323f5f44/users/30a8f92ad6d94f74803dc5af46a6c4e2/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:31:59.838887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2537800-4672-456b-afbd-d5858d6bbcf8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.839176 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2537800-4672-456b-afbd-d5858d6bbcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.839484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2537800-4672-456b-afbd-d5858d6bbcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:31:59.865703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b2537800-4672-456b-afbd-d5858d6bbcf8 None None] MFA Rules not processed for user `30a8f92ad6d94f74803dc5af46a6c4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:31:59.866894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b2537800-4672-456b-afbd-d5858d6bbcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:31:59.928788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1280/2599] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:31:59.933226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a76bc-0b8a-425d-8701-98e5042f7933 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:31:59.993879 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a76bc-0b8a-425d-8701-98e5042f7933 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:31:59.998607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776d793-04c5-4926-b0df-631feefcdba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:31:59.999261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776d793-04c5-4926-b0df-631feefcdba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:31:59.999548 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776d793-04c5-4926-b0df-631feefcdba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:31:59.999844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776d793-04c5-4926-b0df-631feefcdba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.000537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776d793-04c5-4926-b0df-631feefcdba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:00.002441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776d793-04c5-4926-b0df-631feefcdba8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:00.084970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1320/2600] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:31:59 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:00.088915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2537800-4672-456b-afbd-d5858d6bbcf8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:00.100029 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2537800-4672-456b-afbd-d5858d6bbcf8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:00.118110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:00.153837 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512b23-e48f-48f9-8b69-d5b0709213c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:00.154520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512b23-e48f-48f9-8b69-d5b0709213c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:00.154974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512b23-e48f-48f9-8b69-d5b0709213c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:00.155605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512b23-e48f-48f9-8b69-d5b0709213c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.156368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512b23-e48f-48f9-8b69-d5b0709213c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:00.158305 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512b23-e48f-48f9-8b69-d5b0709213c2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:00.210921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1281/2601] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:00 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:00.214825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776d793-04c5-4926-b0df-631feefcdba8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:00.225722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776d793-04c5-4926-b0df-631feefcdba8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:00.230493 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cca71-a917-466c-81ba-3b57f4922f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:00.231143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cca71-a917-466c-81ba-3b57f4922f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:00.231427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cca71-a917-466c-81ba-3b57f4922f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:00.231712 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cca71-a917-466c-81ba-3b57f4922f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.232505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cca71-a917-466c-81ba-3b57f4922f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:00.234088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cca71-a917-466c-81ba-3b57f4922f00 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:00.240075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:00.253002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1321/2602] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:00.253135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512b23-e48f-48f9-8b69-d5b0709213c2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:00.259225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512b23-e48f-48f9-8b69-d5b0709213c2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:00.263895 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff28085-3f15-490c-8153-dbaba83b1992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:00.264585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff28085-3f15-490c-8153-dbaba83b1992 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:00.264872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff28085-3f15-490c-8153-dbaba83b1992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:00.265153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff28085-3f15-490c-8153-dbaba83b1992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.265875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff28085-3f15-490c-8153-dbaba83b1992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:00.267479 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff28085-3f15-490c-8153-dbaba83b1992 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:00.277335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1282/2603] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:00.281158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cca71-a917-466c-81ba-3b57f4922f00 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:00.291310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cca71-a917-466c-81ba-3b57f4922f00 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:00.296452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4acae4-8b86-49ca-a2b3-b555c535f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:00.297313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4acae4-8b86-49ca-a2b3-b555c535f550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:00.298846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4acae4-8b86-49ca-a2b3-b555c535f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:00.298846 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4acae4-8b86-49ca-a2b3-b555c535f550 admin admin] PATH_INFO: `/v3/projects/73f1f704caf347a09dc534b660feeb9a/users/bb5325c1ba4f4ad4bee3cdeb8bfd1972/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.312930 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4acae4-8b86-49ca-a2b3-b555c535f550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f1f704caf347a09dc534b660feeb9a, user_id=bb5325c1ba4f4ad4bee3cdeb8bfd1972, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:00.315570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4acae4-8b86-49ca-a2b3-b555c535f550 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:00.381181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1322/2604] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:00 2022] PUT /identity/v3/projects/73f1f704caf347a09dc534b660feeb9a/users/bb5325c1ba4f4ad4bee3cdeb8bfd1972/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:00.391367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba36f5-0d08-484e-bab5-c5ed20c66646 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:00.391692 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba36f5-0d08-484e-bab5-c5ed20c66646 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:00.391974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba36f5-0d08-484e-bab5-c5ed20c66646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.420402 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-acba36f5-0d08-484e-bab5-c5ed20c66646 None None] MFA Rules not processed for user `bb5325c1ba4f4ad4bee3cdeb8bfd1972`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:00.421630 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-acba36f5-0d08-484e-bab5-c5ed20c66646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:00.484537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1283/2605] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:00.489099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4acae4-8b86-49ca-a2b3-b555c535f550 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:00.550555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4acae4-8b86-49ca-a2b3-b555c535f550 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:00.555261 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2562dcf-b238-473e-b0d7-1b2093eebae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:00.555912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2562dcf-b238-473e-b0d7-1b2093eebae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:00.558841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2562dcf-b238-473e-b0d7-1b2093eebae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:00.558841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2562dcf-b238-473e-b0d7-1b2093eebae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.558841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2562dcf-b238-473e-b0d7-1b2093eebae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:00.559139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2562dcf-b238-473e-b0d7-1b2093eebae8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:00.662677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1323/2606] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:32:00 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:32:00.666781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba36f5-0d08-484e-bab5-c5ed20c66646 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:00.677399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba36f5-0d08-484e-bab5-c5ed20c66646 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:00.734432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31b0bc-4944-4951-ae5b-a5a126b5e81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:00.735099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31b0bc-4944-4951-ae5b-a5a126b5e81d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:00.735382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31b0bc-4944-4951-ae5b-a5a126b5e81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:00.735660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31b0bc-4944-4951-ae5b-a5a126b5e81d admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.736395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31b0bc-4944-4951-ae5b-a5a126b5e81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:00.738333 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31b0bc-4944-4951-ae5b-a5a126b5e81d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:00.813346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1284/2607] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:00 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:00.814626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2562dcf-b238-473e-b0d7-1b2093eebae8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:00.825586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2562dcf-b238-473e-b0d7-1b2093eebae8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:00.830304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a6db-2d2c-4e61-bab0-8337a6a28e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:00.830955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a6db-2d2c-4e61-bab0-8337a6a28e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:00.831241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a6db-2d2c-4e61-bab0-8337a6a28e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:00.831520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a6db-2d2c-4e61-bab0-8337a6a28e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.832856 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9a6db-2d2c-4e61-bab0-8337a6a28e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:00.834443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9a6db-2d2c-4e61-bab0-8337a6a28e2d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:00.844899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1324/2608] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:00.848756 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31b0bc-4944-4951-ae5b-a5a126b5e81d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:00.858668 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31b0bc-4944-4951-ae5b-a5a126b5e81d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:00.863398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd1520-fe89-42ae-a064-c4b6ccfcd332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:00.864266 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd1520-fe89-42ae-a064-c4b6ccfcd332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:00.864608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd1520-fe89-42ae-a064-c4b6ccfcd332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:00.864876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd1520-fe89-42ae-a064-c4b6ccfcd332 admin admin] PATH_INFO: `/v3/projects/e3d0f8236fb74a1f92fc276b5f010236/users/179ad365175c4da8a136bb703bdc9480/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:00.880237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd1520-fe89-42ae-a064-c4b6ccfcd332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d0f8236fb74a1f92fc276b5f010236, user_id=179ad365175c4da8a136bb703bdc9480, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:00.883071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd1520-fe89-42ae-a064-c4b6ccfcd332 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:00.886184 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:00.986411 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1285/2609] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:00 2022] PUT /identity/v3/projects/e3d0f8236fb74a1f92fc276b5f010236/users/179ad365175c4da8a136bb703bdc9480/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:00.990284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a6db-2d2c-4e61-bab0-8337a6a28e2d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:01.000462 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a6db-2d2c-4e61-bab0-8337a6a28e2d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:01.056873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65319690-b348-4648-b992-5372a0884f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:01.057463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65319690-b348-4648-b992-5372a0884f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:01.057742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65319690-b348-4648-b992-5372a0884f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:01.058011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65319690-b348-4648-b992-5372a0884f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:01.058726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65319690-b348-4648-b992-5372a0884f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:01.060571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65319690-b348-4648-b992-5372a0884f88 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:01.070615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1325/2610] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:32:01.074749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd1520-fe89-42ae-a064-c4b6ccfcd332 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:01.085555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd1520-fe89-42ae-a064-c4b6ccfcd332 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:01.090112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d6ed2-369b-4a5f-82b9-c12f6e8c7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:01.090980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d6ed2-369b-4a5f-82b9-c12f6e8c7a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:01.091264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d6ed2-369b-4a5f-82b9-c12f6e8c7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:01.091542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d6ed2-369b-4a5f-82b9-c12f6e8c7a52 admin admin] PATH_INFO: `/v3/projects/e3d0f8236fb74a1f92fc276b5f010236/users/179ad365175c4da8a136bb703bdc9480/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:01.093497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d6ed2-369b-4a5f-82b9-c12f6e8c7a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d0f8236fb74a1f92fc276b5f010236, user_id=179ad365175c4da8a136bb703bdc9480, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:01.096137 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d6ed2-369b-4a5f-82b9-c12f6e8c7a52 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:01.106314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1286/2611] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:01 2022] PUT /identity/v3/projects/e3d0f8236fb74a1f92fc276b5f010236/users/179ad365175c4da8a136bb703bdc9480/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:01.118219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87c0e1-eaf9-462b-92ab-e94cc1d2ea9f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:01.118506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87c0e1-eaf9-462b-92ab-e94cc1d2ea9f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:01.118787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87c0e1-eaf9-462b-92ab-e94cc1d2ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:01.144778 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9d87c0e1-eaf9-462b-92ab-e94cc1d2ea9f None None] MFA Rules not processed for user `179ad365175c4da8a136bb703bdc9480`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:01.145991 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9d87c0e1-eaf9-462b-92ab-e94cc1d2ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:01.177960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:01.213268 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1326/2612] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:01.225080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d6ed2-369b-4a5f-82b9-c12f6e8c7a52 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:01.226838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e21d6ed2-369b-4a5f-82b9-c12f6e8c7a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:01.283318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d6ed2-369b-4a5f-82b9-c12f6e8c7a52 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:01.286984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c73d1-dab5-4d29-a35f-d0e56aa6bde4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:01.287625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c73d1-dab5-4d29-a35f-d0e56aa6bde4 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:01.287913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c73d1-dab5-4d29-a35f-d0e56aa6bde4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:01.288197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c73d1-dab5-4d29-a35f-d0e56aa6bde4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:01.297128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c73d1-dab5-4d29-a35f-d0e56aa6bde4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:01.298560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c73d1-dab5-4d29-a35f-d0e56aa6bde4 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:01.308675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1287/2613] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:01.401869 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87c0e1-eaf9-462b-92ab-e94cc1d2ea9f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:01.403270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9d87c0e1-eaf9-462b-92ab-e94cc1d2ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:01.415058 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87c0e1-eaf9-462b-92ab-e94cc1d2ea9f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:01.418806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee120f-3e83-43c2-941d-f25ca7b954aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:01.419452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee120f-3e83-43c2-941d-f25ca7b954aa service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:01.419742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee120f-3e83-43c2-941d-f25ca7b954aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:01.420052 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee120f-3e83-43c2-941d-f25ca7b954aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:01.476895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee120f-3e83-43c2-941d-f25ca7b954aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:01.478321 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee120f-3e83-43c2-941d-f25ca7b954aa service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:01.487056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1327/2614] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:05.402913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c73d1-dab5-4d29-a35f-d0e56aa6bde4 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:05.464613 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c73d1-dab5-4d29-a35f-d0e56aa6bde4 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:05.469390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:05.470290 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:05.470573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:05.470846 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] PATH_INFO: `/v3/users/30a8f92ad6d94f74803dc5af46a6c4e2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:05.472080 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a8f92ad6d94f74803dc5af46a6c4e2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:05.474056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:05.744774 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a8f92ad6d94f74803dc5af46a6c4e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:05.751725 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a8f92ad6d94f74803dc5af46a6c4e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:05.752430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a8f92ad6d94f74803dc5af46a6c4e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:05.765098 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a8f92ad6d94f74803dc5af46a6c4e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:05.896215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a8f92ad6d94f74803dc5af46a6c4e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:05.902519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1288/2615] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:05 2022] DELETE /identity/v3/users/30a8f92ad6d94f74803dc5af46a6c4e2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:05.908019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c00ff-29c7-4a3e-9632-cf58faae93c8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:05.908019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c00ff-29c7-4a3e-9632-cf58faae93c8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:05.908019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c00ff-29c7-4a3e-9632-cf58faae93c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:05.926279 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0d7c00ff-29c7-4a3e-9632-cf58faae93c8 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:05.929546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0d7c00ff-29c7-4a3e-9632-cf58faae93c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:05.984723 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1328/2616] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:05.995068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:05.996416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:06.002795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:06.051733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1d52d-1337-4e13-93ac-775129b13ee8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:06.055926 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8644b-dd96-455c-910a-d076dded29c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:06.056604 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8644b-dd96-455c-910a-d076dded29c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:06.056886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8644b-dd96-455c-910a-d076dded29c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:06.057163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8644b-dd96-455c-910a-d076dded29c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:06.066246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8644b-dd96-455c-910a-d076dded29c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:06.067790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8644b-dd96-455c-910a-d076dded29c4 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:06.077636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1289/2617] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:06.486474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c00ff-29c7-4a3e-9632-cf58faae93c8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:06.488715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0d7c00ff-29c7-4a3e-9632-cf58faae93c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:06.501436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c00ff-29c7-4a3e-9632-cf58faae93c8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:06.506355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:06.508725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:06.509013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:06.509483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] PATH_INFO: `/v3/projects/a0052bd776c746e5a224aa9f323f5f44` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:06.510737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0052bd776c746e5a224aa9f323f5f44)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:06.517818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:06.611081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0052bd776c746e5a224aa9f323f5f44', 'request_id': 'req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:06.700717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0052bd776c746e5a224aa9f323f5f44', 'request_id': 'req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:06.706334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0052bd776c746e5a224aa9f323f5f44', 'request_id': 'req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:06.707423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:06.718045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] The token cache is being invalidate because project a0052bd776c746e5a224aa9f323f5f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:06.718334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:06.718972 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:06.720654 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1329/2618] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:06 2022] DELETE /identity/v3/projects/a0052bd776c746e5a224aa9f323f5f44 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:06.724686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8644b-dd96-455c-910a-d076dded29c4 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:06.734743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8644b-dd96-455c-910a-d076dded29c4 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:06.790212 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:06.791005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:06.791287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:06.791563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] PATH_INFO: `/v3/users/bb5325c1ba4f4ad4bee3cdeb8bfd1972` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:06.792793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5325c1ba4f4ad4bee3cdeb8bfd1972)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:06.794753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:06.960154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5325c1ba4f4ad4bee3cdeb8bfd1972'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:06.966881 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5325c1ba4f4ad4bee3cdeb8bfd1972'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:06.967542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5325c1ba4f4ad4bee3cdeb8bfd1972'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:06.979553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5325c1ba4f4ad4bee3cdeb8bfd1972'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:07.033277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5325c1ba4f4ad4bee3cdeb8bfd1972'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:07.039660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1290/2619] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:06 2022] DELETE /identity/v3/users/bb5325c1ba4f4ad4bee3cdeb8bfd1972 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:07.463825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:07.465327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:07.478179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948cdd0-9f5e-4aa5-a7f0-e93fe13a1d2c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:07.535570 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:07.536455 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:07.536736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:07.537010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] PATH_INFO: `/v3/projects/73f1f704caf347a09dc534b660feeb9a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:07.538189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f1f704caf347a09dc534b660feeb9a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:07.540066 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:07.666440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f1f704caf347a09dc534b660feeb9a', 'request_id': 'req-1cb0c987-075f-4b65-8e9e-342659ad96c6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:07.793860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f1f704caf347a09dc534b660feeb9a', 'request_id': 'req-1cb0c987-075f-4b65-8e9e-342659ad96c6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:07.799950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f1f704caf347a09dc534b660feeb9a', 'request_id': 'req-1cb0c987-075f-4b65-8e9e-342659ad96c6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:07.811898 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] The token cache is being invalidate because project 73f1f704caf347a09dc534b660feeb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:07.812184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:07.812845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:07.814391 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1330/2620] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:07 2022] DELETE /identity/v3/projects/73f1f704caf347a09dc534b660feeb9a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:07.818390 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:07.820538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:07.832973 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2b44-702c-4aa6-95f7-8a3afd2a1159 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:07.856148 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:07.887879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:07.888760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:07.889043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:07.889312 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] PATH_INFO: `/v3/users/179ad365175c4da8a136bb703bdc9480` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:07.890470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=179ad365175c4da8a136bb703bdc9480)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:07.892442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:08.075331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179ad365175c4da8a136bb703bdc9480'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.082113 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179ad365175c4da8a136bb703bdc9480'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.082761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179ad365175c4da8a136bb703bdc9480'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.094678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179ad365175c4da8a136bb703bdc9480'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.148275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3387e8d-fd0c-461d-b4a2-42d647cc7cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179ad365175c4da8a136bb703bdc9480'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.154461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1291/2621] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:07 2022] DELETE /identity/v3/users/179ad365175c4da8a136bb703bdc9480 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:08.520774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:08.522425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:08.537311 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0c987-075f-4b65-8e9e-342659ad96c6 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:08.594862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:08.595675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:08.595954 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:08.596245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] PATH_INFO: `/v3/projects/e3d0f8236fb74a1f92fc276b5f010236` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:08.597415 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d0f8236fb74a1f92fc276b5f010236)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:08.599637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:08.709155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:08.724760 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d0f8236fb74a1f92fc276b5f010236', 'request_id': 'req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.799326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d0f8236fb74a1f92fc276b5f010236', 'request_id': 'req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.805839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d0f8236fb74a1f92fc276b5f010236', 'request_id': 'req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.817217 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] The token cache is being invalidate because project e3d0f8236fb74a1f92fc276b5f010236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:08.817504 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.818153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1dac4f28-9ef4-48f2-b44a-bf330e793c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:08.820378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1331/2622] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:08 2022] DELETE /identity/v3/projects/e3d0f8236fb74a1f92fc276b5f010236 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:08.826358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0601e-5e0a-4051-a6ef-6fd2ee0bcf0e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:08.832140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0601e-5e0a-4051-a6ef-6fd2ee0bcf0e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:08.832140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0601e-5e0a-4051-a6ef-6fd2ee0bcf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:08.844641 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bde0601e-5e0a-4051-a6ef-6fd2ee0bcf0e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:08.845902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bde0601e-5e0a-4051-a6ef-6fd2ee0bcf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:08.902324 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1292/2623] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:08.910602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52960a7-843c-4e83-b82f-cbb108671493 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:08.910893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52960a7-843c-4e83-b82f-cbb108671493 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:08.911171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52960a7-843c-4e83-b82f-cbb108671493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:08.929986 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f52960a7-843c-4e83-b82f-cbb108671493 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:08.931167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f52960a7-843c-4e83-b82f-cbb108671493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:08.939316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1332/2624] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:08.943520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0601e-5e0a-4051-a6ef-6fd2ee0bcf0e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:08.953038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0601e-5e0a-4051-a6ef-6fd2ee0bcf0e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:08.957591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f26e9-e87b-4dc1-8097-2b0c3483fa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:08.958238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f26e9-e87b-4dc1-8097-2b0c3483fa52 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:08.958523 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f26e9-e87b-4dc1-8097-2b0c3483fa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:08.958801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f26e9-e87b-4dc1-8097-2b0c3483fa52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:08.959516 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f26e9-e87b-4dc1-8097-2b0c3483fa52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:32:08.959829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f26e9-e87b-4dc1-8097-2b0c3483fa52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:08.961466 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f26e9-e87b-4dc1-8097-2b0c3483fa52 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:08.973168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1293/2625] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:32:08.977771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52960a7-843c-4e83-b82f-cbb108671493 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:08.986836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52960a7-843c-4e83-b82f-cbb108671493 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:08.992016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853b3c-91a5-4b24-885d-acd5e0cedbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:08.992685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853b3c-91a5-4b24-885d-acd5e0cedbaf admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:08.992967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853b3c-91a5-4b24-885d-acd5e0cedbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:08.993357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853b3c-91a5-4b24-885d-acd5e0cedbaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:08.993911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef853b3c-91a5-4b24-885d-acd5e0cedbaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:08.995781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef853b3c-91a5-4b24-885d-acd5e0cedbaf admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:09.074531 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1333/2626] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:32:08 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:09.078825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f26e9-e87b-4dc1-8097-2b0c3483fa52 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:09.089291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f26e9-e87b-4dc1-8097-2b0c3483fa52 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:09.120965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:09.145909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e9b6-cca2-4d4a-b135-7ac08e624b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:09.146612 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e9b6-cca2-4d4a-b135-7ac08e624b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:09.146901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e9b6-cca2-4d4a-b135-7ac08e624b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:09.147182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e9b6-cca2-4d4a-b135-7ac08e624b3d admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:09.147872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0e9b6-cca2-4d4a-b135-7ac08e624b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:09.149839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0e9b6-cca2-4d4a-b135-7ac08e624b3d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:09.238820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1294/2627] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:09 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:09.243403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853b3c-91a5-4b24-885d-acd5e0cedbaf admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:09.253633 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853b3c-91a5-4b24-885d-acd5e0cedbaf admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:09.258302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf42e09-fee5-4ecd-a161-bfbc93c9342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:09.258951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf42e09-fee5-4ecd-a161-bfbc93c9342f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:09.259228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf42e09-fee5-4ecd-a161-bfbc93c9342f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:09.259507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf42e09-fee5-4ecd-a161-bfbc93c9342f admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:09.260219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf42e09-fee5-4ecd-a161-bfbc93c9342f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:09.261821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf42e09-fee5-4ecd-a161-bfbc93c9342f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:09.271967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1334/2628] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:09.275766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e9b6-cca2-4d4a-b135-7ac08e624b3d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:09.285832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e9b6-cca2-4d4a-b135-7ac08e624b3d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:09.290862 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841ce4-baf0-4835-bc60-2a0c3f32d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:09.309659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841ce4-baf0-4835-bc60-2a0c3f32d9ca admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:09.309659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841ce4-baf0-4835-bc60-2a0c3f32d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:09.309659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841ce4-baf0-4835-bc60-2a0c3f32d9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:09.309659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17841ce4-baf0-4835-bc60-2a0c3f32d9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:09.309659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17841ce4-baf0-4835-bc60-2a0c3f32d9ca admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:09.309659 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1295/2629] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:09.312470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf42e09-fee5-4ecd-a161-bfbc93c9342f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:09.322229 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf42e09-fee5-4ecd-a161-bfbc93c9342f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:09.326687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796e536-1fd9-404d-8269-308ac06e7566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:09.327541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796e536-1fd9-404d-8269-308ac06e7566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:09.327821 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796e536-1fd9-404d-8269-308ac06e7566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:09.328098 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796e536-1fd9-404d-8269-308ac06e7566 admin admin] PATH_INFO: `/v3/projects/b62fa4a41fad43c7ac5f1accf0b86013/users/c550020555b14b83982eea4edd0fc5c5/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:09.342784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796e536-1fd9-404d-8269-308ac06e7566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62fa4a41fad43c7ac5f1accf0b86013, user_id=c550020555b14b83982eea4edd0fc5c5, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:09.345423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796e536-1fd9-404d-8269-308ac06e7566 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:09.444367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1335/2630] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:09 2022] PUT /identity/v3/projects/b62fa4a41fad43c7ac5f1accf0b86013/users/c550020555b14b83982eea4edd0fc5c5/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:09.455346 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056e9a7-5978-4324-aa86-2f48d2b641c5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:09.455636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056e9a7-5978-4324-aa86-2f48d2b641c5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:09.455909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056e9a7-5978-4324-aa86-2f48d2b641c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:09.482704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c056e9a7-5978-4324-aa86-2f48d2b641c5 None None] MFA Rules not processed for user `c550020555b14b83982eea4edd0fc5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:09.483886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c056e9a7-5978-4324-aa86-2f48d2b641c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:09.547652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1296/2631] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:09.559175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796e536-1fd9-404d-8269-308ac06e7566 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:09.562580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2796e536-1fd9-404d-8269-308ac06e7566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:09.618271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796e536-1fd9-404d-8269-308ac06e7566 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:09.621980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018636f5-79ec-4849-b245-a8f911fe74b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:09.622618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018636f5-79ec-4849-b245-a8f911fe74b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:09.622901 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018636f5-79ec-4849-b245-a8f911fe74b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:09.623173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018636f5-79ec-4849-b245-a8f911fe74b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:09.631267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018636f5-79ec-4849-b245-a8f911fe74b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:09.632835 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018636f5-79ec-4849-b245-a8f911fe74b1 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:09.641709 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1336/2632] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:09.661362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056e9a7-5978-4324-aa86-2f48d2b641c5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:09.723572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056e9a7-5978-4324-aa86-2f48d2b641c5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:09.728083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:09.729043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:09.729301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:09.729575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] PATH_INFO: `/v3/users/c550020555b14b83982eea4edd0fc5c5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:09.730765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c550020555b14b83982eea4edd0fc5c5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:09.732738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:09.878074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:09.880584 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c550020555b14b83982eea4edd0fc5c5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:09.887603 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c550020555b14b83982eea4edd0fc5c5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:09.888251 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c550020555b14b83982eea4edd0fc5c5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:09.900246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c550020555b14b83982eea4edd0fc5c5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:09.976058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c550020555b14b83982eea4edd0fc5c5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:09.982099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1297/2633] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:09 2022] DELETE /identity/v3/users/c550020555b14b83982eea4edd0fc5c5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:09.986660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe4c5c-08ff-4254-8acd-d325ccd91e1e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:09.986956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe4c5c-08ff-4254-8acd-d325ccd91e1e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:09.987238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe4c5c-08ff-4254-8acd-d325ccd91e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:10.004616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-96fe4c5c-08ff-4254-8acd-d325ccd91e1e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:10.005808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-96fe4c5c-08ff-4254-8acd-d325ccd91e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:10.052503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:10.064964 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1337/2634] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:10.075149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:10.076657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:10.132780 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a041-4e0b-4b28-90a8-efd8b4fece04 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:10.136572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be72f3a-9691-4e33-9667-74d74a864370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:10.137224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be72f3a-9691-4e33-9667-74d74a864370 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:10.137616 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be72f3a-9691-4e33-9667-74d74a864370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:10.137899 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be72f3a-9691-4e33-9667-74d74a864370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:10.146932 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be72f3a-9691-4e33-9667-74d74a864370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:10.148489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be72f3a-9691-4e33-9667-74d74a864370 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:10.158864 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1298/2635] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:10.498632 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe4c5c-08ff-4254-8acd-d325ccd91e1e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:10.500166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-96fe4c5c-08ff-4254-8acd-d325ccd91e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:10.512599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe4c5c-08ff-4254-8acd-d325ccd91e1e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:10.517162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:10.518016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:10.518291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:10.518563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] PATH_INFO: `/v3/projects/b62fa4a41fad43c7ac5f1accf0b86013` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:10.519863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62fa4a41fad43c7ac5f1accf0b86013)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:10.521893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:10.662174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62fa4a41fad43c7ac5f1accf0b86013', 'request_id': 'req-454c98ff-0f33-40c0-977c-b66f48434a87'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:10.736436 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62fa4a41fad43c7ac5f1accf0b86013', 'request_id': 'req-454c98ff-0f33-40c0-977c-b66f48434a87'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:10.742894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62fa4a41fad43c7ac5f1accf0b86013', 'request_id': 'req-454c98ff-0f33-40c0-977c-b66f48434a87'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:10.754002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] The token cache is being invalidate because project b62fa4a41fad43c7ac5f1accf0b86013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:10.754233 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:10.754859 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-454c98ff-0f33-40c0-977c-b66f48434a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:10.756423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1338/2636] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:10 2022] DELETE /identity/v3/projects/b62fa4a41fad43c7ac5f1accf0b86013 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:10.761432 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a31009-a1e3-4886-9f20-2ff75aa8baf7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:10.761722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a31009-a1e3-4886-9f20-2ff75aa8baf7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:10.762049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a31009-a1e3-4886-9f20-2ff75aa8baf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:10.779126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-58a31009-a1e3-4886-9f20-2ff75aa8baf7 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:10.780325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-58a31009-a1e3-4886-9f20-2ff75aa8baf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:10.839172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1299/2637] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:10.847675 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37dab0-3508-49e7-8896-3f83f0da256b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:10.847969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37dab0-3508-49e7-8896-3f83f0da256b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:10.848251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37dab0-3508-49e7-8896-3f83f0da256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:10.866924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1d37dab0-3508-49e7-8896-3f83f0da256b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:10.868121 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1d37dab0-3508-49e7-8896-3f83f0da256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:10.875989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1339/2638] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:10.879907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a31009-a1e3-4886-9f20-2ff75aa8baf7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:10.889563 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a31009-a1e3-4886-9f20-2ff75aa8baf7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:10.894091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b2799-36fc-4a71-b8ca-fa4330a1e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:10.894730 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b2799-36fc-4a71-b8ca-fa4330a1e648 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:10.895011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b2799-36fc-4a71-b8ca-fa4330a1e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:10.895283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b2799-36fc-4a71-b8ca-fa4330a1e648 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:10.895995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b2799-36fc-4a71-b8ca-fa4330a1e648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:32:10.896300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b2799-36fc-4a71-b8ca-fa4330a1e648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:10.898462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b2799-36fc-4a71-b8ca-fa4330a1e648 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:10.909683 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1300/2639] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:32:10.914235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37dab0-3508-49e7-8896-3f83f0da256b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:10.923207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37dab0-3508-49e7-8896-3f83f0da256b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:10.927791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286652f-39f2-4a7b-84c8-f479467803ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:10.928467 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286652f-39f2-4a7b-84c8-f479467803ce admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:10.928754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286652f-39f2-4a7b-84c8-f479467803ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:10.929031 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286652f-39f2-4a7b-84c8-f479467803ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:10.929718 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286652f-39f2-4a7b-84c8-f479467803ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:10.931590 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286652f-39f2-4a7b-84c8-f479467803ce admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:10.994350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1340/2640] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:32:10 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:10.998299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b2799-36fc-4a71-b8ca-fa4330a1e648 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:11.008041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b2799-36fc-4a71-b8ca-fa4330a1e648 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:11.054643 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:11.064582 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb0c40-c7d4-4962-99b0-f9f2f98581d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:11.068689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0c40-c7d4-4962-99b0-f9f2f98581d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:11.068689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0c40-c7d4-4962-99b0-f9f2f98581d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:11.068689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0c40-c7d4-4962-99b0-f9f2f98581d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:11.068689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb0c40-c7d4-4962-99b0-f9f2f98581d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:11.068689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb0c40-c7d4-4962-99b0-f9f2f98581d2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:11.130048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1301/2641] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:10 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:11.134061 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286652f-39f2-4a7b-84c8-f479467803ce admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:11.144190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286652f-39f2-4a7b-84c8-f479467803ce admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:11.149389 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b958-b195-403a-b8b9-1310bef2f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:11.150042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b958-b195-403a-b8b9-1310bef2f360 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:11.150323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b958-b195-403a-b8b9-1310bef2f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:11.150599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b958-b195-403a-b8b9-1310bef2f360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:11.151316 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b958-b195-403a-b8b9-1310bef2f360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:11.152932 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b958-b195-403a-b8b9-1310bef2f360 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:11.163781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1341/2642] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:11.167684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb0c40-c7d4-4962-99b0-f9f2f98581d2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:11.177461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb0c40-c7d4-4962-99b0-f9f2f98581d2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:11.181984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5624108-0e2d-4a15-994e-9f34d166a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:11.182623 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5624108-0e2d-4a15-994e-9f34d166a275 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:11.182902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5624108-0e2d-4a15-994e-9f34d166a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:11.183179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5624108-0e2d-4a15-994e-9f34d166a275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:11.183924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5624108-0e2d-4a15-994e-9f34d166a275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:11.185808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5624108-0e2d-4a15-994e-9f34d166a275 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:11.195938 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1302/2643] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:32:11.199659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b958-b195-403a-b8b9-1310bef2f360 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:11.209533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b958-b195-403a-b8b9-1310bef2f360 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:11.214757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a6ca3-b3cc-47a4-9729-7c4725625d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:11.215619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a6ca3-b3cc-47a4-9729-7c4725625d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:11.215905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a6ca3-b3cc-47a4-9729-7c4725625d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:11.216254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a6ca3-b3cc-47a4-9729-7c4725625d3f admin admin] PATH_INFO: `/v3/projects/01e4bdf0992d4f318f491418de1cc6eb/users/ba98710798b04bcbb098a40f5ab3b58a/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:11.230811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a6ca3-b3cc-47a4-9729-7c4725625d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e4bdf0992d4f318f491418de1cc6eb, user_id=ba98710798b04bcbb098a40f5ab3b58a, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:11.233546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a6ca3-b3cc-47a4-9729-7c4725625d3f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:11.295686 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1342/2644] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:11 2022] PUT /identity/v3/projects/01e4bdf0992d4f318f491418de1cc6eb/users/ba98710798b04bcbb098a40f5ab3b58a/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:11.305727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd4b10-8af2-45d9-900c-bd682a6a9e59 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:11.306025 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd4b10-8af2-45d9-900c-bd682a6a9e59 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:11.306311 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd4b10-8af2-45d9-900c-bd682a6a9e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:11.333075 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2ecd4b10-8af2-45d9-900c-bd682a6a9e59 None None] MFA Rules not processed for user `ba98710798b04bcbb098a40f5ab3b58a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:11.334270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2ecd4b10-8af2-45d9-900c-bd682a6a9e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:11.396463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1303/2645] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:11.407756 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a6ca3-b3cc-47a4-9729-7c4725625d3f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:11.409477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-485a6ca3-b3cc-47a4-9729-7c4725625d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:11.465157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a6ca3-b3cc-47a4-9729-7c4725625d3f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:11.468774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f558eb-0c32-469a-8753-481e12129545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:11.469409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f558eb-0c32-469a-8753-481e12129545 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:11.469705 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f558eb-0c32-469a-8753-481e12129545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:11.469971 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f558eb-0c32-469a-8753-481e12129545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:11.478244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f558eb-0c32-469a-8753-481e12129545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:11.479669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f558eb-0c32-469a-8753-481e12129545 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:11.488296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1343/2646] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:15.493986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd4b10-8af2-45d9-900c-bd682a6a9e59 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:15.557783 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd4b10-8af2-45d9-900c-bd682a6a9e59 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:15.562553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:15.563406 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:15.563687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:15.563961 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] PATH_INFO: `/v3/users/ba98710798b04bcbb098a40f5ab3b58a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:15.565197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba98710798b04bcbb098a40f5ab3b58a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:15.567114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:15.732048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba98710798b04bcbb098a40f5ab3b58a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:15.738716 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba98710798b04bcbb098a40f5ab3b58a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:15.739363 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba98710798b04bcbb098a40f5ab3b58a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:15.743662 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:15.751306 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba98710798b04bcbb098a40f5ab3b58a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:15.827675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba98710798b04bcbb098a40f5ab3b58a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:15.833983 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1304/2647] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:15 2022] DELETE /identity/v3/users/ba98710798b04bcbb098a40f5ab3b58a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:15.839127 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7140b6-71d0-4d64-86aa-5e0a6639be36 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:15.839576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7140b6-71d0-4d64-86aa-5e0a6639be36 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:15.839676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7140b6-71d0-4d64-86aa-5e0a6639be36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:15.857082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-cc7140b6-71d0-4d64-86aa-5e0a6639be36 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:15.858259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cc7140b6-71d0-4d64-86aa-5e0a6639be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:15.867283 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:15.914969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1344/2648] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:15.924534 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:15.925935 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:15.983924 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769b0d2-1050-48b4-8178-f13958d0a5a4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:15.987556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0662a-ae40-4f34-8003-184565ea537c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:15.988195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0662a-ae40-4f34-8003-184565ea537c service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:15.988529 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0662a-ae40-4f34-8003-184565ea537c service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:15.988804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0662a-ae40-4f34-8003-184565ea537c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:15.997915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0662a-ae40-4f34-8003-184565ea537c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:15.999345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0662a-ae40-4f34-8003-184565ea537c service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:16.009229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1305/2649] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:16.405231 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7140b6-71d0-4d64-86aa-5e0a6639be36 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:16.406677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cc7140b6-71d0-4d64-86aa-5e0a6639be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:16.420927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7140b6-71d0-4d64-86aa-5e0a6639be36 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:16.425639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:16.427326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:16.427626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:16.427958 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] PATH_INFO: `/v3/projects/01e4bdf0992d4f318f491418de1cc6eb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:16.431687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e4bdf0992d4f318f491418de1cc6eb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:16.433832 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:16.554772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e4bdf0992d4f318f491418de1cc6eb', 'request_id': 'req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:16.621746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e4bdf0992d4f318f491418de1cc6eb', 'request_id': 'req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:16.627519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e4bdf0992d4f318f491418de1cc6eb', 'request_id': 'req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:16.638427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] The token cache is being invalidate because project 01e4bdf0992d4f318f491418de1cc6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:16.638714 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:16.639343 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-de51a38b-a837-43af-97a7-d6d5c1aa8bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:16.640910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1345/2650] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:16 2022] DELETE /identity/v3/projects/01e4bdf0992d4f318f491418de1cc6eb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:16.646004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f98fd-2de6-43ce-91a8-e421e41aac6a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:16.646472 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f98fd-2de6-43ce-91a8-e421e41aac6a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:16.646570 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f98fd-2de6-43ce-91a8-e421e41aac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:16.664462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-851f98fd-2de6-43ce-91a8-e421e41aac6a None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:16.665664 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-851f98fd-2de6-43ce-91a8-e421e41aac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:16.723386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1306/2651] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:16.731865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801bc82-7c8a-4106-aa69-b26de46bb154 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:16.732159 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801bc82-7c8a-4106-aa69-b26de46bb154 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:16.732480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801bc82-7c8a-4106-aa69-b26de46bb154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:16.751177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2801bc82-7c8a-4106-aa69-b26de46bb154 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:16.752401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2801bc82-7c8a-4106-aa69-b26de46bb154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:16.760295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1346/2652] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:32:16.764260 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f98fd-2de6-43ce-91a8-e421e41aac6a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:16.773840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f98fd-2de6-43ce-91a8-e421e41aac6a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:16.778440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fd088-9c04-4551-9983-c047fbb301a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:16.779089 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fd088-9c04-4551-9983-c047fbb301a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:16.779377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fd088-9c04-4551-9983-c047fbb301a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:16.779653 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fd088-9c04-4551-9983-c047fbb301a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:16.780409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fd088-9c04-4551-9983-c047fbb301a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:32:16.780720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fd088-9c04-4551-9983-c047fbb301a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:16.782341 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fd088-9c04-4551-9983-c047fbb301a6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:16.794400 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1307/2653] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:32:16.798641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801bc82-7c8a-4106-aa69-b26de46bb154 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:16.808546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801bc82-7c8a-4106-aa69-b26de46bb154 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:16.813396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a44cb-efe4-494c-9e7b-02d4814ed888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:16.814045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a44cb-efe4-494c-9e7b-02d4814ed888 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:16.814332 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a44cb-efe4-494c-9e7b-02d4814ed888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:16.814610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a44cb-efe4-494c-9e7b-02d4814ed888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:16.815308 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a44cb-efe4-494c-9e7b-02d4814ed888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:16.817251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a44cb-efe4-494c-9e7b-02d4814ed888 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:16.895744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1347/2654] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:32:16 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:32:16.900459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fd088-9c04-4551-9983-c047fbb301a6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:16.910418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fd088-9c04-4551-9983-c047fbb301a6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:16.966675 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc51b98-6542-444d-88cc-7b9dad5faab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:16.967345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc51b98-6542-444d-88cc-7b9dad5faab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:16.967628 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc51b98-6542-444d-88cc-7b9dad5faab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:16.967903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc51b98-6542-444d-88cc-7b9dad5faab3 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:16.968617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc51b98-6542-444d-88cc-7b9dad5faab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:16.970571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc51b98-6542-444d-88cc-7b9dad5faab3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:17.079330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:17.086207 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1308/2655] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:16 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:17.089619 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a44cb-efe4-494c-9e7b-02d4814ed888 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:17.101294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a44cb-efe4-494c-9e7b-02d4814ed888 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:17.105980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db42ff-99a0-4247-822e-8ebc2645bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:17.106648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db42ff-99a0-4247-822e-8ebc2645bea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:17.106939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db42ff-99a0-4247-822e-8ebc2645bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:17.107218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db42ff-99a0-4247-822e-8ebc2645bea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:17.107937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db42ff-99a0-4247-822e-8ebc2645bea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:17.109591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db42ff-99a0-4247-822e-8ebc2645bea4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:17.119926 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1348/2656] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:32:17.123880 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc51b98-6542-444d-88cc-7b9dad5faab3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:17.133672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc51b98-6542-444d-88cc-7b9dad5faab3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:17.138828 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d782c-f3bf-49fb-b3a7-5414978dda4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:17.139508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d782c-f3bf-49fb-b3a7-5414978dda4a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:17.139792 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d782c-f3bf-49fb-b3a7-5414978dda4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:17.140069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d782c-f3bf-49fb-b3a7-5414978dda4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:17.140838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d782c-f3bf-49fb-b3a7-5414978dda4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:17.142442 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d782c-f3bf-49fb-b3a7-5414978dda4a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:17.153272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1309/2657] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:17.157382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db42ff-99a0-4247-822e-8ebc2645bea4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:17.167890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db42ff-99a0-4247-822e-8ebc2645bea4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:17.172560 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40fd00-1f91-4cc7-8102-ece7a6b7acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:17.173429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40fd00-1f91-4cc7-8102-ece7a6b7acef admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:17.173717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40fd00-1f91-4cc7-8102-ece7a6b7acef admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:17.173998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40fd00-1f91-4cc7-8102-ece7a6b7acef admin admin] PATH_INFO: `/v3/projects/2a9440b115e44c3dba179bae7392ca7c/users/a8aeadcefdfd4d34b9fe73ee4dec9b44/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:17.189034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40fd00-1f91-4cc7-8102-ece7a6b7acef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9440b115e44c3dba179bae7392ca7c, user_id=a8aeadcefdfd4d34b9fe73ee4dec9b44, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:17.191668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40fd00-1f91-4cc7-8102-ece7a6b7acef admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:17.284681 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1349/2658] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:17 2022] PUT /identity/v3/projects/2a9440b115e44c3dba179bae7392ca7c/users/a8aeadcefdfd4d34b9fe73ee4dec9b44/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:32:17.349250 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885239-8078-445f-a204-e64ebe9f4702 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:17.349461 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885239-8078-445f-a204-e64ebe9f4702 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:17.349721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885239-8078-445f-a204-e64ebe9f4702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:17.375527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8d885239-8078-445f-a204-e64ebe9f4702 None None] MFA Rules not processed for user `a8aeadcefdfd4d34b9fe73ee4dec9b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:17.376763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8d885239-8078-445f-a204-e64ebe9f4702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:17.438698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1310/2659] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:17.450461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40fd00-1f91-4cc7-8102-ece7a6b7acef admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:17.452235 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8d40fd00-1f91-4cc7-8102-ece7a6b7acef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:17.492940 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:17.509963 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40fd00-1f91-4cc7-8102-ece7a6b7acef admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:17.513657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb05a3c-9d5a-4867-8832-15074273703c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b95fdb06a94c1586148df32413085f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:17.514305 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb05a3c-9d5a-4867-8832-15074273703c service glance] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:17.514591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb05a3c-9d5a-4867-8832-15074273703c service glance] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:17.514871 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb05a3c-9d5a-4867-8832-15074273703c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:17.524019 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb05a3c-9d5a-4867-8832-15074273703c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:17.525485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb05a3c-9d5a-4867-8832-15074273703c service glance] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:17.534697 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1350/2660] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:27.435906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=38 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:27.604774 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=10 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:41.929694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d885239-8078-445f-a204-e64ebe9f4702 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:41.931078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8d885239-8078-445f-a204-e64ebe9f4702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:41.986367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d885239-8078-445f-a204-e64ebe9f4702 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:41.989900 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290befd-bdc3-417f-9902-09d22557abc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:41.990535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290befd-bdc3-417f-9902-09d22557abc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:41.990819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290befd-bdc3-417f-9902-09d22557abc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:41.991097 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290befd-bdc3-417f-9902-09d22557abc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:41.992853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7290befd-bdc3-417f-9902-09d22557abc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:42.062951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290befd-bdc3-417f-9902-09d22557abc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:42.064419 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290befd-bdc3-417f-9902-09d22557abc1 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:42.074357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1311/2661] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:45.696324 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb05a3c-9d5a-4867-8832-15074273703c service glance] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:45.697856 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-eeb05a3c-9d5a-4867-8832-15074273703c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:45.713865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb05a3c-9d5a-4867-8832-15074273703c service glance] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:45.719010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:45.719893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:45.720172 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:45.724210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] PATH_INFO: `/v3/users/53490cc482c149eaa28f80b868dba094` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:45.724210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=53490cc482c149eaa28f80b868dba094)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:45.724210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:45.810277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290befd-bdc3-417f-9902-09d22557abc1 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:45.820088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290befd-bdc3-417f-9902-09d22557abc1 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:45.825564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:45.826434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:45.826738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:45.827010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] PATH_INFO: `/v3/users/a8aeadcefdfd4d34b9fe73ee4dec9b44` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:45.828267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8aeadcefdfd4d34b9fe73ee4dec9b44)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:45.830323 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:45.931567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53490cc482c149eaa28f80b868dba094'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:45.932219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53490cc482c149eaa28f80b868dba094'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:45.939789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53490cc482c149eaa28f80b868dba094'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:45.940388 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53490cc482c149eaa28f80b868dba094'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:45.953055 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5dc3bc4c-1afb-4ddb-98d5-5ea645298fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53490cc482c149eaa28f80b868dba094'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.046221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8aeadcefdfd4d34b9fe73ee4dec9b44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.053560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8aeadcefdfd4d34b9fe73ee4dec9b44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.054256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8aeadcefdfd4d34b9fe73ee4dec9b44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.055662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1351/2662] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:45 2022] DELETE /identity/v3/users/53490cc482c149eaa28f80b868dba094 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:46.066850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8aeadcefdfd4d34b9fe73ee4dec9b44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.129746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8aeadcefdfd4d34b9fe73ee4dec9b44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.136301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1312/2663] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:45 2022] DELETE /identity/v3/users/a8aeadcefdfd4d34b9fe73ee4dec9b44 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:46.141803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22fc1-2a8d-49a1-a66e-6c70c6dd3827 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:46.142099 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22fc1-2a8d-49a1-a66e-6c70c6dd3827 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:46.142377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22fc1-2a8d-49a1-a66e-6c70c6dd3827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:46.160244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d1a22fc1-2a8d-49a1-a66e-6c70c6dd3827 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:46.161469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d1a22fc1-2a8d-49a1-a66e-6c70c6dd3827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:46.222222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1352/2664] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:46.231550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:46.232971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:46.259020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:46.288654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b92a99-2b1b-4114-ac66-b4e15504add1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:46.292145 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a933b-009e-4aea-9fd5-c859213b5f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:46.292812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a933b-009e-4aea-9fd5-c859213b5f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:46.293671 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a933b-009e-4aea-9fd5-c859213b5f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:46.293997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a933b-009e-4aea-9fd5-c859213b5f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:46.302698 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a933b-009e-4aea-9fd5-c859213b5f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:46.304124 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a933b-009e-4aea-9fd5-c859213b5f47 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:46.314061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1313/2665] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:46.339520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22fc1-2a8d-49a1-a66e-6c70c6dd3827 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:46.339520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d1a22fc1-2a8d-49a1-a66e-6c70c6dd3827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:46.351484 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22fc1-2a8d-49a1-a66e-6c70c6dd3827 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:46.356781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:46.357828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:46.358107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:46.358382 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] PATH_INFO: `/v3/projects/597d293d24fc4c6a92ac537cefd258a7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:46.359565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=597d293d24fc4c6a92ac537cefd258a7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:46.361544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:46.490859 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597d293d24fc4c6a92ac537cefd258a7', 'request_id': 'req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.569952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597d293d24fc4c6a92ac537cefd258a7', 'request_id': 'req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.576600 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597d293d24fc4c6a92ac537cefd258a7', 'request_id': 'req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.580239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:46.588027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] The token cache is being invalidate because project 597d293d24fc4c6a92ac537cefd258a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:46.588329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.588992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5ef5920e-5fbe-42b6-8b1f-8645215f1c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.590677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1353/2666] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:46 2022] DELETE /identity/v3/projects/597d293d24fc4c6a92ac537cefd258a7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:46.595561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b771073-37af-4d0f-8025-a371762d456e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:46.595859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b771073-37af-4d0f-8025-a371762d456e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:46.596139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b771073-37af-4d0f-8025-a371762d456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:46.614500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6b771073-37af-4d0f-8025-a371762d456e None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:46.622180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6b771073-37af-4d0f-8025-a371762d456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:46.694323 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1314/2667] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:46.702792 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d4b2a-e1bd-465a-addd-02aa9157e261 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:46.703314 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d4b2a-e1bd-465a-addd-02aa9157e261 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:46.703426 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d4b2a-e1bd-465a-addd-02aa9157e261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:46.724371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e50d4b2a-e1bd-465a-addd-02aa9157e261 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:46.725628 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e50d4b2a-e1bd-465a-addd-02aa9157e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:46.733622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1354/2668] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:32:46.737777 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b771073-37af-4d0f-8025-a371762d456e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:46.748044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b771073-37af-4d0f-8025-a371762d456e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:46.752622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:46.753335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:46.753556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:46.753832 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:46.754558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:32:46.754867 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:46.756494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:46.769131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1315/2669] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:32:46.773385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d4b2a-e1bd-465a-addd-02aa9157e261 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:46.782864 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d4b2a-e1bd-465a-addd-02aa9157e261 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:46.787942 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eff04a-f4b4-4785-8eae-d5c8f5aa7c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:46.788710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eff04a-f4b4-4785-8eae-d5c8f5aa7c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:46.790920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eff04a-f4b4-4785-8eae-d5c8f5aa7c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:46.791045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:46.791137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eff04a-f4b4-4785-8eae-d5c8f5aa7c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:46.791137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eff04a-f4b4-4785-8eae-d5c8f5aa7c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:46.791280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:46.792128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eff04a-f4b4-4785-8eae-d5c8f5aa7c09 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:46.806596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394344a1-73d4-4543-9085-c181043b5c6e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:46.812696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:46.813573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:46.813946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:46.814194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] PATH_INFO: `/v3/projects/2a9440b115e44c3dba179bae7392ca7c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:46.815407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9440b115e44c3dba179bae7392ca7c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:46.817379 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:46.914214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1355/2670] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:32:46 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:32:46.918744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eff04a-f4b4-4785-8eae-d5c8f5aa7c09 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:46.936809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9440b115e44c3dba179bae7392ca7c', 'request_id': 'req-c3d92806-c027-4ba7-8301-4bf7fea99764'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:46.979563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eff04a-f4b4-4785-8eae-d5c8f5aa7c09 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:47.004335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9440b115e44c3dba179bae7392ca7c', 'request_id': 'req-c3d92806-c027-4ba7-8301-4bf7fea99764'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:47.013520 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9440b115e44c3dba179bae7392ca7c', 'request_id': 'req-c3d92806-c027-4ba7-8301-4bf7fea99764'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:47.024536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] The token cache is being invalidate because project 2a9440b115e44c3dba179bae7392ca7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:47.024897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:47.025561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:47.027399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1316/2671] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:46 2022] DELETE /identity/v3/projects/2a9440b115e44c3dba179bae7392ca7c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:47.043918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0798c6a-ff9b-460b-9d8d-c785bec43d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:47.044683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0798c6a-ff9b-460b-9d8d-c785bec43d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.044966 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0798c6a-ff9b-460b-9d8d-c785bec43d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.045241 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0798c6a-ff9b-460b-9d8d-c785bec43d82 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.045948 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0798c6a-ff9b-460b-9d8d-c785bec43d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:47.047949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0798c6a-ff9b-460b-9d8d-c785bec43d82 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:47.131127 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1356/2672] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:46 2022] POST /identity/v3/users => generated 302 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:32:47.135294 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:47.136956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:47.150293 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d92806-c027-4ba7-8301-4bf7fea99764 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:47.155042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcbd43-9b59-449f-ad2d-203b92ac0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:47.155731 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcbd43-9b59-449f-ad2d-203b92ac0faa admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.156020 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcbd43-9b59-449f-ad2d-203b92ac0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.156296 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcbd43-9b59-449f-ad2d-203b92ac0faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.157063 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcbd43-9b59-449f-ad2d-203b92ac0faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:47.158697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcbd43-9b59-449f-ad2d-203b92ac0faa admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:47.170044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1317/2673] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:47.174365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0798c6a-ff9b-460b-9d8d-c785bec43d82 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:47.186040 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0798c6a-ff9b-460b-9d8d-c785bec43d82 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:47.191109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b22102-c3f8-4e54-b80c-b48619b2a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:47.191896 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b22102-c3f8-4e54-b80c-b48619b2a7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.192237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b22102-c3f8-4e54-b80c-b48619b2a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.192608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b22102-c3f8-4e54-b80c-b48619b2a7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.193416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b22102-c3f8-4e54-b80c-b48619b2a7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:47.195104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b22102-c3f8-4e54-b80c-b48619b2a7fd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:47.210095 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1357/2674] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:32:47.211319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcbd43-9b59-449f-ad2d-203b92ac0faa admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:47.222252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcbd43-9b59-449f-ad2d-203b92ac0faa admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:47.226948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abb520-f03d-4afd-ab7d-1cd22a870b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:47.227843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abb520-f03d-4afd-ab7d-1cd22a870b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.228123 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abb520-f03d-4afd-ab7d-1cd22a870b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.228435 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abb520-f03d-4afd-ab7d-1cd22a870b5b admin admin] PATH_INFO: `/v3/projects/4054a756a25e4fa6a1e1c1fffee1ab7b/users/d0c0b51dacec4bf3b6d89c5b32a80e5f/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.244857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abb520-f03d-4afd-ab7d-1cd22a870b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4054a756a25e4fa6a1e1c1fffee1ab7b, user_id=d0c0b51dacec4bf3b6d89c5b32a80e5f, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:47.248153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abb520-f03d-4afd-ab7d-1cd22a870b5b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:47.309694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:47.314392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1318/2675] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:47 2022] PUT /identity/v3/projects/4054a756a25e4fa6a1e1c1fffee1ab7b/users/d0c0b51dacec4bf3b6d89c5b32a80e5f/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:47.328194 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877926-9d42-46fe-8e56-b132284e40ff None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.328537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877926-9d42-46fe-8e56-b132284e40ff None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.328820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877926-9d42-46fe-8e56-b132284e40ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.354713 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-59877926-9d42-46fe-8e56-b132284e40ff None None] MFA Rules not processed for user `d0c0b51dacec4bf3b6d89c5b32a80e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:47.356509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-59877926-9d42-46fe-8e56-b132284e40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:47.397167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:47.419825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1358/2676] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:47.424230 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abb520-f03d-4afd-ab7d-1cd22a870b5b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:47.484644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abb520-f03d-4afd-ab7d-1cd22a870b5b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:47.489469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b8097-ef52-4402-af8e-288633d858f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:47.490126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b8097-ef52-4402-af8e-288633d858f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.490665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b8097-ef52-4402-af8e-288633d858f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.490970 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b8097-ef52-4402-af8e-288633d858f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.492056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b8097-ef52-4402-af8e-288633d858f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:47.494045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b8097-ef52-4402-af8e-288633d858f8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:47.598953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1319/2677] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:32:47 2022] POST /identity/v3/projects => generated 405 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:32:47.602861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59877926-9d42-46fe-8e56-b132284e40ff None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:47.614145 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59877926-9d42-46fe-8e56-b132284e40ff None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:47.669863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aef6e4-a629-4e14-a627-41d37bb7e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:47.670534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aef6e4-a629-4e14-a627-41d37bb7e722 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.670823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aef6e4-a629-4e14-a627-41d37bb7e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.671105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aef6e4-a629-4e14-a627-41d37bb7e722 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.671791 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aef6e4-a629-4e14-a627-41d37bb7e722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:47.673761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aef6e4-a629-4e14-a627-41d37bb7e722 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:47.757222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1359/2678] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:47 2022] POST /identity/v3/users => generated 309 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:47.761227 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b8097-ef52-4402-af8e-288633d858f8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:47.771550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b8097-ef52-4402-af8e-288633d858f8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:47.776222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06dd4e-4cff-4942-9ea5-e9e10bb910eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:47.776913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06dd4e-4cff-4942-9ea5-e9e10bb910eb admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.777183 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06dd4e-4cff-4942-9ea5-e9e10bb910eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.777989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06dd4e-4cff-4942-9ea5-e9e10bb910eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.778755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06dd4e-4cff-4942-9ea5-e9e10bb910eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:47.780374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06dd4e-4cff-4942-9ea5-e9e10bb910eb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:47.790821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1320/2679] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:47.795566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aef6e4-a629-4e14-a627-41d37bb7e722 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:47.805762 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aef6e4-a629-4e14-a627-41d37bb7e722 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:47.810979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012f52d-c582-4d9b-8f3d-cee924809433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:47.811857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012f52d-c582-4d9b-8f3d-cee924809433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.812137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012f52d-c582-4d9b-8f3d-cee924809433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.812468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012f52d-c582-4d9b-8f3d-cee924809433 admin admin] PATH_INFO: `/v3/projects/01ecd0b1f43e4df895c0d205625b570a/users/3128e5f059e74e0785c39f6959a6cf3f/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.827430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012f52d-c582-4d9b-8f3d-cee924809433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ecd0b1f43e4df895c0d205625b570a, user_id=3128e5f059e74e0785c39f6959a6cf3f, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:47.830181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012f52d-c582-4d9b-8f3d-cee924809433 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:47.900009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1360/2680] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:47 2022] PUT /identity/v3/projects/01ecd0b1f43e4df895c0d205625b570a/users/3128e5f059e74e0785c39f6959a6cf3f/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:47.904648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06dd4e-4cff-4942-9ea5-e9e10bb910eb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:47.914735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06dd4e-4cff-4942-9ea5-e9e10bb910eb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:47.969838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cf2f3-9bdd-428d-bc8a-0d523be955db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:47.970619 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf2f3-9bdd-428d-bc8a-0d523be955db admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:47.970902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf2f3-9bdd-428d-bc8a-0d523be955db admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:47.971174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf2f3-9bdd-428d-bc8a-0d523be955db admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:47.971886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cf2f3-9bdd-428d-bc8a-0d523be955db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:47.973503 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cf2f3-9bdd-428d-bc8a-0d523be955db admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:47.982929 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1321/2681] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:32:47.986966 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012f52d-c582-4d9b-8f3d-cee924809433 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:47.997018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012f52d-c582-4d9b-8f3d-cee924809433 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:48.001501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff81bc1-37f4-4496-a964-8e27547a47ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:48.002360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81bc1-37f4-4496-a964-8e27547a47ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:48.002638 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81bc1-37f4-4496-a964-8e27547a47ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:48.002908 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81bc1-37f4-4496-a964-8e27547a47ae admin admin] PATH_INFO: `/v3/projects/01ecd0b1f43e4df895c0d205625b570a/users/3128e5f059e74e0785c39f6959a6cf3f/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:48.004873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff81bc1-37f4-4496-a964-8e27547a47ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ecd0b1f43e4df895c0d205625b570a, user_id=3128e5f059e74e0785c39f6959a6cf3f, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:48.007506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff81bc1-37f4-4496-a964-8e27547a47ae admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:48.018243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1361/2682] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:47 2022] PUT /identity/v3/projects/01ecd0b1f43e4df895c0d205625b570a/users/3128e5f059e74e0785c39f6959a6cf3f/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:48.029786 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6e0c-b1b6-435c-a7e0-af0943054d1b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:48.030083 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6e0c-b1b6-435c-a7e0-af0943054d1b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:48.030367 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6e0c-b1b6-435c-a7e0-af0943054d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:48.055906 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c7ab6e0c-b1b6-435c-a7e0-af0943054d1b None None] MFA Rules not processed for user `3128e5f059e74e0785c39f6959a6cf3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:48.057145 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c7ab6e0c-b1b6-435c-a7e0-af0943054d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:48.115037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:48.123755 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1322/2683] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:48.134173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff81bc1-37f4-4496-a964-8e27547a47ae admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:48.135928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dff81bc1-37f4-4496-a964-8e27547a47ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:48.194955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff81bc1-37f4-4496-a964-8e27547a47ae admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:48.198588 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd6498-58da-447b-8df1-6fcee46f5c36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:48.199825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd6498-58da-447b-8df1-6fcee46f5c36 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:48.200129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd6498-58da-447b-8df1-6fcee46f5c36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:48.200446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd6498-58da-447b-8df1-6fcee46f5c36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:48.209475 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd6498-58da-447b-8df1-6fcee46f5c36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:48.210882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd6498-58da-447b-8df1-6fcee46f5c36 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:48.220101 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1362/2684] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:48.347948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6e0c-b1b6-435c-a7e0-af0943054d1b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:48.409136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6e0c-b1b6-435c-a7e0-af0943054d1b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:48.413642 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:48.414511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:48.414793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:48.415070 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] PATH_INFO: `/v3/users/d0c0b51dacec4bf3b6d89c5b32a80e5f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:48.416240 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c0b51dacec4bf3b6d89c5b32a80e5f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:48.418189 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:48.577838 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c0b51dacec4bf3b6d89c5b32a80e5f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:48.584771 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c0b51dacec4bf3b6d89c5b32a80e5f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:48.585422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c0b51dacec4bf3b6d89c5b32a80e5f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:48.597104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c0b51dacec4bf3b6d89c5b32a80e5f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:48.644175 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c0b51dacec4bf3b6d89c5b32a80e5f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:48.650288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1323/2685] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:48 2022] DELETE /identity/v3/users/d0c0b51dacec4bf3b6d89c5b32a80e5f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:48.654850 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c4464-9210-409a-8def-d6f4647e370c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:48.655144 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c4464-9210-409a-8def-d6f4647e370c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:48.657169 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c4464-9210-409a-8def-d6f4647e370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:48.673227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c23c4464-9210-409a-8def-d6f4647e370c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:48.674410 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c23c4464-9210-409a-8def-d6f4647e370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:48.706483 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:48.732866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1363/2686] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:48.742357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:48.743760 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:48.800670 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b39df-d30b-4643-b3df-171d0abe1f29 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:48.804517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1876ab-1e45-44bb-91e6-4dc461d72297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:48.805167 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1876ab-1e45-44bb-91e6-4dc461d72297 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:48.805477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1876ab-1e45-44bb-91e6-4dc461d72297 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:48.805757 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1876ab-1e45-44bb-91e6-4dc461d72297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:48.815580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1876ab-1e45-44bb-91e6-4dc461d72297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:48.817049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1876ab-1e45-44bb-91e6-4dc461d72297 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:48.826364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1324/2687] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:49.245862 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c4464-9210-409a-8def-d6f4647e370c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:49.247399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c23c4464-9210-409a-8def-d6f4647e370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:49.259432 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c4464-9210-409a-8def-d6f4647e370c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:49.264135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:49.265017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:49.265302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:49.265575 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] PATH_INFO: `/v3/projects/4054a756a25e4fa6a1e1c1fffee1ab7b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:49.266759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4054a756a25e4fa6a1e1c1fffee1ab7b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:49.268818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:49.369892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4054a756a25e4fa6a1e1c1fffee1ab7b', 'request_id': 'req-3ef77156-554d-44a2-a3ed-b4df3678711d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.472416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4054a756a25e4fa6a1e1c1fffee1ab7b', 'request_id': 'req-3ef77156-554d-44a2-a3ed-b4df3678711d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.478319 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4054a756a25e4fa6a1e1c1fffee1ab7b', 'request_id': 'req-3ef77156-554d-44a2-a3ed-b4df3678711d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.489488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] The token cache is being invalidate because project 4054a756a25e4fa6a1e1c1fffee1ab7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:49.489776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.490466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.492018 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1364/2688] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:49 2022] DELETE /identity/v3/projects/4054a756a25e4fa6a1e1c1fffee1ab7b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:49.496237 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1876ab-1e45-44bb-91e6-4dc461d72297 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:49.506042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1876ab-1e45-44bb-91e6-4dc461d72297 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:49.518854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:49.562172 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:49.563026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:49.563358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:49.563637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] PATH_INFO: `/v3/users/3128e5f059e74e0785c39f6959a6cf3f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:49.564840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3128e5f059e74e0785c39f6959a6cf3f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:49.566778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:49.782365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3128e5f059e74e0785c39f6959a6cf3f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.789185 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3128e5f059e74e0785c39f6959a6cf3f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.789879 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3128e5f059e74e0785c39f6959a6cf3f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.801789 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3128e5f059e74e0785c39f6959a6cf3f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.872946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b30da590-5768-4b3d-bd64-188d022507c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3128e5f059e74e0785c39f6959a6cf3f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:49.879069 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1325/2689] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:49 2022] DELETE /identity/v3/users/3128e5f059e74e0785c39f6959a6cf3f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:50.274139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:50.283223 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:50.288401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef77156-554d-44a2-a3ed-b4df3678711d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:50.344222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:50.345100 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:50.345386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:50.345738 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] PATH_INFO: `/v3/projects/01ecd0b1f43e4df895c0d205625b570a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:50.346845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ecd0b1f43e4df895c0d205625b570a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:50.348785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:50.453710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ecd0b1f43e4df895c0d205625b570a', 'request_id': 'req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:50.522510 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ecd0b1f43e4df895c0d205625b570a', 'request_id': 'req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:50.527834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:50.529106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ecd0b1f43e4df895c0d205625b570a', 'request_id': 'req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:50.539859 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] The token cache is being invalidate because project 01ecd0b1f43e4df895c0d205625b570a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:50.540158 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:50.540875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bb7b92f4-5127-4d34-bc3a-373e17bb2b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:50.542393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1365/2690] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:50 2022] DELETE /identity/v3/projects/01ecd0b1f43e4df895c0d205625b570a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:50.547884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f1147-b208-4074-a3cc-670aef7b4dd2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:50.548438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f1147-b208-4074-a3cc-670aef7b4dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:50.548438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f1147-b208-4074-a3cc-670aef7b4dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:50.568364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4b9f1147-b208-4074-a3cc-670aef7b4dd2 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:50.569728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4b9f1147-b208-4074-a3cc-670aef7b4dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:50.629448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1326/2691] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:50.637132 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0941-5c18-4b00-b86b-ed929c38d1db None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:50.637425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0941-5c18-4b00-b86b-ed929c38d1db None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:50.637751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0941-5c18-4b00-b86b-ed929c38d1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:50.656221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-99de0941-5c18-4b00-b86b-ed929c38d1db None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:50.657452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-99de0941-5c18-4b00-b86b-ed929c38d1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:50.665330 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1366/2692] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:50.670057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f1147-b208-4074-a3cc-670aef7b4dd2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:50.679578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f1147-b208-4074-a3cc-670aef7b4dd2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:50.684696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d3c81-b772-4c2c-9539-3496151a3792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:50.685351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d3c81-b772-4c2c-9539-3496151a3792 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:50.685636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d3c81-b772-4c2c-9539-3496151a3792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:50.685912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d3c81-b772-4c2c-9539-3496151a3792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:50.686689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d3c81-b772-4c2c-9539-3496151a3792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:32:50.687016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d3c81-b772-4c2c-9539-3496151a3792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:50.688657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d3c81-b772-4c2c-9539-3496151a3792 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:50.700747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1327/2693] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:32:50.704911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0941-5c18-4b00-b86b-ed929c38d1db None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:50.714310 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0941-5c18-4b00-b86b-ed929c38d1db None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:50.719703 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d20d-af23-4db2-a3d8-fb97cf03a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:50.720438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d20d-af23-4db2-a3d8-fb97cf03a96d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:50.720727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d20d-af23-4db2-a3d8-fb97cf03a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:50.721004 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d20d-af23-4db2-a3d8-fb97cf03a96d admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:50.721727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7d20d-af23-4db2-a3d8-fb97cf03a96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:50.723670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7d20d-af23-4db2-a3d8-fb97cf03a96d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:50.854447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1367/2694] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:32:50 2022] POST /identity/v3/projects => generated 401 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:32:50.855658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d3c81-b772-4c2c-9539-3496151a3792 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:50.865718 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d3c81-b772-4c2c-9539-3496151a3792 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:50.885544 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:50.922987 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff893ec-06f3-4a92-9c71-e9a064bbe2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:50.923667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff893ec-06f3-4a92-9c71-e9a064bbe2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:50.923953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff893ec-06f3-4a92-9c71-e9a064bbe2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:50.924233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff893ec-06f3-4a92-9c71-e9a064bbe2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:50.924969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff893ec-06f3-4a92-9c71-e9a064bbe2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:50.926901 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff893ec-06f3-4a92-9c71-e9a064bbe2a6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.048226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1328/2695] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:50 2022] POST /identity/v3/users => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:32:51.049506 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d20d-af23-4db2-a3d8-fb97cf03a96d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:51.060684 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d20d-af23-4db2-a3d8-fb97cf03a96d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:51.065213 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2325d-d841-479a-931c-cb3ef4412002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:51.065919 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2325d-d841-479a-931c-cb3ef4412002 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.066199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2325d-d841-479a-931c-cb3ef4412002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.066482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2325d-d841-479a-931c-cb3ef4412002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.067198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2325d-d841-479a-931c-cb3ef4412002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:51.068823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2325d-d841-479a-931c-cb3ef4412002 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.083049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1368/2696] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:51.094279 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff893ec-06f3-4a92-9c71-e9a064bbe2a6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:51.094485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff893ec-06f3-4a92-9c71-e9a064bbe2a6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:51.099315 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b4155-cad1-4b59-a350-d2e93ad4b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:51.100032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b4155-cad1-4b59-a350-d2e93ad4b684 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.100332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b4155-cad1-4b59-a350-d2e93ad4b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.100629 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b4155-cad1-4b59-a350-d2e93ad4b684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.101481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b4155-cad1-4b59-a350-d2e93ad4b684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:51.103088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b4155-cad1-4b59-a350-d2e93ad4b684 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.114044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1329/2697] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:32:51.118356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2325d-d841-479a-931c-cb3ef4412002 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:51.129239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2325d-d841-479a-931c-cb3ef4412002 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:51.133957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec72438-348a-41ed-a480-a677f055f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:51.134843 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec72438-348a-41ed-a480-a677f055f995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.135128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec72438-348a-41ed-a480-a677f055f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.135439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec72438-348a-41ed-a480-a677f055f995 admin admin] PATH_INFO: `/v3/projects/a202b807caf4441e9e7239e4b027d2d9/users/5edf2407b0404047a3cb83e54d1a8562/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.150412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec72438-348a-41ed-a480-a677f055f995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a202b807caf4441e9e7239e4b027d2d9, user_id=5edf2407b0404047a3cb83e54d1a8562, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:51.153674 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec72438-348a-41ed-a480-a677f055f995 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.244174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1369/2698] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:51 2022] PUT /identity/v3/projects/a202b807caf4441e9e7239e4b027d2d9/users/5edf2407b0404047a3cb83e54d1a8562/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:51.254431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c8a8-9fe9-40e5-8221-2e2542cb086c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.259608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c8a8-9fe9-40e5-8221-2e2542cb086c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.259608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c8a8-9fe9-40e5-8221-2e2542cb086c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.283211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-55f3c8a8-9fe9-40e5-8221-2e2542cb086c None None] MFA Rules not processed for user `5edf2407b0404047a3cb83e54d1a8562`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:51.284465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-55f3c8a8-9fe9-40e5-8221-2e2542cb086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:51.348037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1330/2699] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:51.352529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec72438-348a-41ed-a480-a677f055f995 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:51.412989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec72438-348a-41ed-a480-a677f055f995 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:51.417517 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae70b-7abe-4b86-b5ff-f169d2ed30c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:51.418157 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae70b-7abe-4b86-b5ff-f169d2ed30c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.419054 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae70b-7abe-4b86-b5ff-f169d2ed30c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.419327 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae70b-7abe-4b86-b5ff-f169d2ed30c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.420009 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae70b-7abe-4b86-b5ff-f169d2ed30c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:51.421918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae70b-7abe-4b86-b5ff-f169d2ed30c7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.525102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1370/2700] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:32:51 2022] POST /identity/v3/projects => generated 401 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:51.529734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c8a8-9fe9-40e5-8221-2e2542cb086c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:51.540347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c8a8-9fe9-40e5-8221-2e2542cb086c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:51.595238 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17847393-a08e-4967-8785-8fb124bc8570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:51.595903 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17847393-a08e-4967-8785-8fb124bc8570 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.596193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17847393-a08e-4967-8785-8fb124bc8570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.596505 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17847393-a08e-4967-8785-8fb124bc8570 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.597191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17847393-a08e-4967-8785-8fb124bc8570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:51.599156 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17847393-a08e-4967-8785-8fb124bc8570 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.695060 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1331/2701] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:51 2022] POST /identity/v3/users => generated 307 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:51.699012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae70b-7abe-4b86-b5ff-f169d2ed30c7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:51.709795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae70b-7abe-4b86-b5ff-f169d2ed30c7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:51.714378 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918efc-e5df-4c2a-8ea1-8557dab4e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:51.715031 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918efc-e5df-4c2a-8ea1-8557dab4e4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.719660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918efc-e5df-4c2a-8ea1-8557dab4e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.719660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918efc-e5df-4c2a-8ea1-8557dab4e4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.719660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8918efc-e5df-4c2a-8ea1-8557dab4e4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:51.719660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8918efc-e5df-4c2a-8ea1-8557dab4e4d0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.729010 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1371/2702] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:32:51.732965 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17847393-a08e-4967-8785-8fb124bc8570 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:51.742672 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17847393-a08e-4967-8785-8fb124bc8570 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:51.747133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c79e5-b367-4734-a5d4-ba2a186dace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:51.747995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c79e5-b367-4734-a5d4-ba2a186dace7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.748274 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c79e5-b367-4734-a5d4-ba2a186dace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.748573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c79e5-b367-4734-a5d4-ba2a186dace7 admin admin] PATH_INFO: `/v3/projects/d47f00121b274eff95e4be5fb9914389/users/cc1c1e28e1474cd6b000a96fa150bcdb/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.763228 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c79e5-b367-4734-a5d4-ba2a186dace7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47f00121b274eff95e4be5fb9914389, user_id=cc1c1e28e1474cd6b000a96fa150bcdb, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:51.765993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c79e5-b367-4734-a5d4-ba2a186dace7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.810766 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:51.816365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1332/2703] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:51 2022] PUT /identity/v3/projects/d47f00121b274eff95e4be5fb9914389/users/cc1c1e28e1474cd6b000a96fa150bcdb/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:51.825933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918efc-e5df-4c2a-8ea1-8557dab4e4d0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:51.835998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918efc-e5df-4c2a-8ea1-8557dab4e4d0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:51.890800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526bf38-f687-4469-a578-2cb8f0eb6393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:51.891393 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526bf38-f687-4469-a578-2cb8f0eb6393 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.891680 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526bf38-f687-4469-a578-2cb8f0eb6393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.891990 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526bf38-f687-4469-a578-2cb8f0eb6393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.892735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526bf38-f687-4469-a578-2cb8f0eb6393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:51.894315 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526bf38-f687-4469-a578-2cb8f0eb6393 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.896273 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:51.904855 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1372/2704] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:32:51.908875 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c79e5-b367-4734-a5d4-ba2a186dace7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:51.919032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c79e5-b367-4734-a5d4-ba2a186dace7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:51.923654 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eac80-2838-4e6c-a86b-83dafea6e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:51.924566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eac80-2838-4e6c-a86b-83dafea6e39c admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.924857 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eac80-2838-4e6c-a86b-83dafea6e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.925133 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eac80-2838-4e6c-a86b-83dafea6e39c admin admin] PATH_INFO: `/v3/projects/d47f00121b274eff95e4be5fb9914389/users/cc1c1e28e1474cd6b000a96fa150bcdb/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.927078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992eac80-2838-4e6c-a86b-83dafea6e39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47f00121b274eff95e4be5fb9914389, user_id=cc1c1e28e1474cd6b000a96fa150bcdb, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:51.929784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992eac80-2838-4e6c-a86b-83dafea6e39c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:51.940808 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1333/2705] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:32:51 2022] PUT /identity/v3/projects/d47f00121b274eff95e4be5fb9914389/users/cc1c1e28e1474cd6b000a96fa150bcdb/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:51.952571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708ede-912b-4303-8dd5-e5a08916c1d4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:51.952861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708ede-912b-4303-8dd5-e5a08916c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:51.953139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708ede-912b-4303-8dd5-e5a08916c1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:51.979965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-12708ede-912b-4303-8dd5-e5a08916c1d4 None None] MFA Rules not processed for user `cc1c1e28e1474cd6b000a96fa150bcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:51.981190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-12708ede-912b-4303-8dd5-e5a08916c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:52.047563 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1373/2706] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:32:52.058131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eac80-2838-4e6c-a86b-83dafea6e39c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:52.060594 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-992eac80-2838-4e6c-a86b-83dafea6e39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:52.115487 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eac80-2838-4e6c-a86b-83dafea6e39c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:52.119332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2e9a2-2d11-4e77-9b11-bc7b2cc4e33a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:52.119969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2e9a2-2d11-4e77-9b11-bc7b2cc4e33a service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:52.120256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2e9a2-2d11-4e77-9b11-bc7b2cc4e33a service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:52.120559 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2e9a2-2d11-4e77-9b11-bc7b2cc4e33a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:52.129976 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2e9a2-2d11-4e77-9b11-bc7b2cc4e33a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:52.131415 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2e9a2-2d11-4e77-9b11-bc7b2cc4e33a service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:52.141309 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1334/2707] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:52 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:52.339441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12708ede-912b-4303-8dd5-e5a08916c1d4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:52.349197 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12708ede-912b-4303-8dd5-e5a08916c1d4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:52.352811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff698c14-f2f0-4a95-8def-148d03ae8756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:52.353457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff698c14-f2f0-4a95-8def-148d03ae8756 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:52.353717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff698c14-f2f0-4a95-8def-148d03ae8756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:52.353993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff698c14-f2f0-4a95-8def-148d03ae8756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:52.409578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff698c14-f2f0-4a95-8def-148d03ae8756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:52.410935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff698c14-f2f0-4a95-8def-148d03ae8756 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:52.420190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1374/2708] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:57.330701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2e9a2-2d11-4e77-9b11-bc7b2cc4e33a service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:57.392072 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2e9a2-2d11-4e77-9b11-bc7b2cc4e33a service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:57.396962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:57.397843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:57.398127 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:57.398454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] PATH_INFO: `/v3/users/5edf2407b0404047a3cb83e54d1a8562` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:57.399660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5edf2407b0404047a3cb83e54d1a8562)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:57.401778 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:57.686673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5edf2407b0404047a3cb83e54d1a8562'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:57.693357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5edf2407b0404047a3cb83e54d1a8562'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:57.694090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5edf2407b0404047a3cb83e54d1a8562'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:57.705727 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5edf2407b0404047a3cb83e54d1a8562'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:57.752456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5edf2407b0404047a3cb83e54d1a8562'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:57.760226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1335/2709] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:57 2022] DELETE /identity/v3/users/5edf2407b0404047a3cb83e54d1a8562 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:57.764824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b7b9-546d-4fed-840e-3680ec663faf None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:57.765304 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b7b9-546d-4fed-840e-3680ec663faf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:57.765412 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b7b9-546d-4fed-840e-3680ec663faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:57.782494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6155b7b9-546d-4fed-840e-3680ec663faf None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:57.783771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6155b7b9-546d-4fed-840e-3680ec663faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:57.841771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1375/2710] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:57.851291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:57.852697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:57.862801 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:57.909587 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a2f5-f4ca-42b2-a643-72703b99ca1d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:57.913795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64056170-089f-46f6-99ea-751f83ede6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:57.914433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64056170-089f-46f6-99ea-751f83ede6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:57.914715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64056170-089f-46f6-99ea-751f83ede6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:57.914988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64056170-089f-46f6-99ea-751f83ede6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:57.924460 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64056170-089f-46f6-99ea-751f83ede6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:57.925893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64056170-089f-46f6-99ea-751f83ede6c1 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:57.935362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1336/2711] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:32:58.330366 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b7b9-546d-4fed-840e-3680ec663faf None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:58.331818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6155b7b9-546d-4fed-840e-3680ec663faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:58.345299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b7b9-546d-4fed-840e-3680ec663faf None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:58.349990 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:58.350857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:58.351137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:58.351422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] PATH_INFO: `/v3/projects/a202b807caf4441e9e7239e4b027d2d9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:58.352666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a202b807caf4441e9e7239e4b027d2d9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:58.354591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:58.371716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:58.483116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a202b807caf4441e9e7239e4b027d2d9', 'request_id': 'req-572fd539-9392-4db8-8eb1-5bd19566cbac'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.551059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a202b807caf4441e9e7239e4b027d2d9', 'request_id': 'req-572fd539-9392-4db8-8eb1-5bd19566cbac'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.556625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a202b807caf4441e9e7239e4b027d2d9', 'request_id': 'req-572fd539-9392-4db8-8eb1-5bd19566cbac'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.567784 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] The token cache is being invalidate because project a202b807caf4441e9e7239e4b027d2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:58.568069 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.568708 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.570244 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1376/2712] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:58 2022] DELETE /identity/v3/projects/a202b807caf4441e9e7239e4b027d2d9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:58.574339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64056170-089f-46f6-99ea-751f83ede6c1 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:58.587711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64056170-089f-46f6-99ea-751f83ede6c1 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:58.644894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:58.645768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:58.646052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:58.646330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] PATH_INFO: `/v3/users/cc1c1e28e1474cd6b000a96fa150bcdb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:58.647508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1c1e28e1474cd6b000a96fa150bcdb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:58.649477 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:58.845270 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1c1e28e1474cd6b000a96fa150bcdb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.852052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1c1e28e1474cd6b000a96fa150bcdb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.852776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1c1e28e1474cd6b000a96fa150bcdb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.864784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1c1e28e1474cd6b000a96fa150bcdb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.935822 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1832d7a8-2258-45f0-aec2-749a26ee0a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1c1e28e1474cd6b000a96fa150bcdb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:58.942221 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1337/2713] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:32:58 2022] DELETE /identity/v3/users/cc1c1e28e1474cd6b000a96fa150bcdb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:59.359646 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:59.361175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:59.376115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fd539-9392-4db8-8eb1-5bd19566cbac admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:59.433834 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:59.434716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:59.434998 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:59.435270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] PATH_INFO: `/v3/projects/d47f00121b274eff95e4be5fb9914389` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:59.436457 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47f00121b274eff95e4be5fb9914389)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:59.438387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:59.535536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47f00121b274eff95e4be5fb9914389', 'request_id': 'req-28f9b01e-92ae-4788-8abf-5adecee552d1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:59.627180 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47f00121b274eff95e4be5fb9914389', 'request_id': 'req-28f9b01e-92ae-4788-8abf-5adecee552d1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:59.633233 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47f00121b274eff95e4be5fb9914389', 'request_id': 'req-28f9b01e-92ae-4788-8abf-5adecee552d1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:59.645296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] The token cache is being invalidate because project d47f00121b274eff95e4be5fb9914389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:32:59.645582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:59.646206 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-28f9b01e-92ae-4788-8abf-5adecee552d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:32:59.647769 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1377/2714] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:32:59 2022] DELETE /identity/v3/projects/d47f00121b274eff95e4be5fb9914389 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:32:59.652577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83450c9-aa31-4367-94ea-c22d56b37d24 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:59.653038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83450c9-aa31-4367-94ea-c22d56b37d24 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:59.653187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83450c9-aa31-4367-94ea-c22d56b37d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:59.671378 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d83450c9-aa31-4367-94ea-c22d56b37d24 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:59.673749 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d83450c9-aa31-4367-94ea-c22d56b37d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:59.696882 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:32:59.731059 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1338/2715] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:59.738976 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba17b5b-2c77-4820-ba45-9518c6f252e5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:59.739317 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba17b5b-2c77-4820-ba45-9518c6f252e5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:59.739599 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba17b5b-2c77-4820-ba45-9518c6f252e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:59.758219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5ba17b5b-2c77-4820-ba45-9518c6f252e5 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:32:59.759443 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5ba17b5b-2c77-4820-ba45-9518c6f252e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:32:59.767929 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1378/2716] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:32:59.772005 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83450c9-aa31-4367-94ea-c22d56b37d24 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:59.781549 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83450c9-aa31-4367-94ea-c22d56b37d24 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:59.786134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0a66-6cdc-4b94-b9dd-e9e049877da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:59.786790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0a66-6cdc-4b94-b9dd-e9e049877da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:59.787074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0a66-6cdc-4b94-b9dd-e9e049877da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:59.787351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0a66-6cdc-4b94-b9dd-e9e049877da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:59.788116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d0a66-6cdc-4b94-b9dd-e9e049877da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:32:59.788457 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d0a66-6cdc-4b94-b9dd-e9e049877da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:59.790106 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d0a66-6cdc-4b94-b9dd-e9e049877da3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:59.802648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1339/2717] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:32:59.806905 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba17b5b-2c77-4820-ba45-9518c6f252e5 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:59.816886 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba17b5b-2c77-4820-ba45-9518c6f252e5 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:59.821539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ccb00-08cc-43bd-b129-9693be76426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:32:59.822184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ccb00-08cc-43bd-b129-9693be76426a admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:32:59.822466 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ccb00-08cc-43bd-b129-9693be76426a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:32:59.822743 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ccb00-08cc-43bd-b129-9693be76426a admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:32:59.823425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ccb00-08cc-43bd-b129-9693be76426a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:32:59.825357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ccb00-08cc-43bd-b129-9693be76426a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:32:59.930525 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1379/2718] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:32:59 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:32:59.935225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0a66-6cdc-4b94-b9dd-e9e049877da3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:32:59.945094 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0a66-6cdc-4b94-b9dd-e9e049877da3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:32:59.999562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7a4da-4b82-4842-abb5-43ef39b95b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:00.000225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7a4da-4b82-4842-abb5-43ef39b95b67 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:00.000537 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7a4da-4b82-4842-abb5-43ef39b95b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:00.000844 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7a4da-4b82-4842-abb5-43ef39b95b67 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:00.001541 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7a4da-4b82-4842-abb5-43ef39b95b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:00.003470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7a4da-4b82-4842-abb5-43ef39b95b67 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:00.084011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1340/2719] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:32:59 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:33:00.087885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ccb00-08cc-43bd-b129-9693be76426a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:00.098264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ccb00-08cc-43bd-b129-9693be76426a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:00.102894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95dec-9378-4413-ab8e-dc5157be4358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:00.103572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95dec-9378-4413-ab8e-dc5157be4358 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:00.103893 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95dec-9378-4413-ab8e-dc5157be4358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:00.104177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95dec-9378-4413-ab8e-dc5157be4358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:00.104928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95dec-9378-4413-ab8e-dc5157be4358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:00.109222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95dec-9378-4413-ab8e-dc5157be4358 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:00.109222 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:00.117767 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1380/2720] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:33:00.121831 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7a4da-4b82-4842-abb5-43ef39b95b67 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:00.132170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7a4da-4b82-4842-abb5-43ef39b95b67 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:00.137495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd7778-2b7c-499e-9e2e-337d14b212fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:00.137495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7778-2b7c-499e-9e2e-337d14b212fa admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:00.137737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7778-2b7c-499e-9e2e-337d14b212fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:00.137959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7778-2b7c-499e-9e2e-337d14b212fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:00.138678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd7778-2b7c-499e-9e2e-337d14b212fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:00.140280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd7778-2b7c-499e-9e2e-337d14b212fa admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:00.150023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1341/2721] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:33:00.154461 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95dec-9378-4413-ab8e-dc5157be4358 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:00.164904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95dec-9378-4413-ab8e-dc5157be4358 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:00.170356 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18c668-4b9a-43c8-9346-1082b1f47c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:00.171221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18c668-4b9a-43c8-9346-1082b1f47c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:00.171507 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18c668-4b9a-43c8-9346-1082b1f47c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:00.171786 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18c668-4b9a-43c8-9346-1082b1f47c66 admin admin] PATH_INFO: `/v3/projects/71949b24e7fc42a4b8c2ce34149a77a3/users/0eaa437095db4f49bd6298ac6d2ed44e/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:00.186936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18c668-4b9a-43c8-9346-1082b1f47c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71949b24e7fc42a4b8c2ce34149a77a3, user_id=0eaa437095db4f49bd6298ac6d2ed44e, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:00.189568 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18c668-4b9a-43c8-9346-1082b1f47c66 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:00.265220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1381/2722] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:33:00 2022] PUT /identity/v3/projects/71949b24e7fc42a4b8c2ce34149a77a3/users/0eaa437095db4f49bd6298ac6d2ed44e/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:00.275409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a4733-57dd-407d-bc90-0d804839c6d3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:00.280775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a4733-57dd-407d-bc90-0d804839c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:00.280775 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a4733-57dd-407d-bc90-0d804839c6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:00.302962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4b6a4733-57dd-407d-bc90-0d804839c6d3 None None] MFA Rules not processed for user `0eaa437095db4f49bd6298ac6d2ed44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:00.304170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4b6a4733-57dd-407d-bc90-0d804839c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:00.365950 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1342/2723] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:00.376931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18c668-4b9a-43c8-9346-1082b1f47c66 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:00.378611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fb18c668-4b9a-43c8-9346-1082b1f47c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:00.433984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18c668-4b9a-43c8-9346-1082b1f47c66 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:00.437702 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c781c70-50de-411e-ac51-f4658e9a0ba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:00.438272 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c781c70-50de-411e-ac51-f4658e9a0ba8 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:00.438549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c781c70-50de-411e-ac51-f4658e9a0ba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:00.438822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c781c70-50de-411e-ac51-f4658e9a0ba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:00.446956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c781c70-50de-411e-ac51-f4658e9a0ba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:00.448383 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c781c70-50de-411e-ac51-f4658e9a0ba8 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:00.456880 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1382/2724] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:10.363086 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:10.452961 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:15.714944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a4733-57dd-407d-bc90-0d804839c6d3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:15.716381 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4b6a4733-57dd-407d-bc90-0d804839c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:15.728331 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a4733-57dd-407d-bc90-0d804839c6d3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:15.731826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8294-d269-4ade-9ee9-fc70e56edd41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:15.732522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8294-d269-4ade-9ee9-fc70e56edd41 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:15.732805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8294-d269-4ade-9ee9-fc70e56edd41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:15.733079 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8294-d269-4ade-9ee9-fc70e56edd41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:15.735277 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1f9e8294-d269-4ade-9ee9-fc70e56edd41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:15.805044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e8294-d269-4ade-9ee9-fc70e56edd41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:15.806486 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e8294-d269-4ade-9ee9-fc70e56edd41 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:15.817501 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1343/2725] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:15.988931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c781c70-50de-411e-ac51-f4658e9a0ba8 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:16.053307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c781c70-50de-411e-ac51-f4658e9a0ba8 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:16.058365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:16.059237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:16.059551 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:16.059830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] PATH_INFO: `/v3/users/0eaa437095db4f49bd6298ac6d2ed44e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:16.061064 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaa437095db4f49bd6298ac6d2ed44e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:16.063025 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:16.245782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaa437095db4f49bd6298ac6d2ed44e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:16.246435 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaa437095db4f49bd6298ac6d2ed44e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:16.253355 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaa437095db4f49bd6298ac6d2ed44e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:16.254013 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaa437095db4f49bd6298ac6d2ed44e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:16.266875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaa437095db4f49bd6298ac6d2ed44e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:16.316303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1383/2726] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:33:15 2022] DELETE /identity/v3/users/0eaa437095db4f49bd6298ac6d2ed44e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:16.320890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ccc8-3b92-478a-9fca-d982fb2f918d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:16.325006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ccc8-3b92-478a-9fca-d982fb2f918d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:16.325006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ccc8-3b92-478a-9fca-d982fb2f918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:16.339103 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b6f9ccc8-3b92-478a-9fca-d982fb2f918d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:16.340302 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b6f9ccc8-3b92-478a-9fca-d982fb2f918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:16.399821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1344/2727] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:16.409384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:16.410849 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:16.466822 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120d9f9-a140-493a-82f2-c4e110cc0e46 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:16.470411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55338917-a136-4c15-afb4-a505d55d6c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:16.471049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338917-a136-4c15-afb4-a505d55d6c35 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:16.471334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338917-a136-4c15-afb4-a505d55d6c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:16.471611 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338917-a136-4c15-afb4-a505d55d6c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:16.480559 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55338917-a136-4c15-afb4-a505d55d6c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:16.481973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55338917-a136-4c15-afb4-a505d55d6c35 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:16.491710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1384/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:16.890728 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9ccc8-3b92-478a-9fca-d982fb2f918d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:16.892151 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b6f9ccc8-3b92-478a-9fca-d982fb2f918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:16.904790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9ccc8-3b92-478a-9fca-d982fb2f918d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:16.910149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:16.911014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:16.911297 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:16.911700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] PATH_INFO: `/v3/projects/71949b24e7fc42a4b8c2ce34149a77a3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:16.913246 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] RBAC: Authorizing `identity:delete_project(project_id=71949b24e7fc42a4b8c2ce34149a77a3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:16.916335 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:16.997373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71949b24e7fc42a4b8c2ce34149a77a3', 'request_id': 'req-a49798dd-7173-4747-a931-e9e9ac7badef'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:17.048688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71949b24e7fc42a4b8c2ce34149a77a3', 'request_id': 'req-a49798dd-7173-4747-a931-e9e9ac7badef'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:17.055088 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71949b24e7fc42a4b8c2ce34149a77a3', 'request_id': 'req-a49798dd-7173-4747-a931-e9e9ac7badef'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:17.065723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] The token cache is being invalidate because project 71949b24e7fc42a4b8c2ce34149a77a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:33:17.066010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:17.066632 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a49798dd-7173-4747-a931-e9e9ac7badef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:17.068147 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1345/2729] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:33:16 2022] DELETE /identity/v3/projects/71949b24e7fc42a4b8c2ce34149a77a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:17.073034 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982da3a-b112-450b-a559-e7acd753a6c3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.073534 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982da3a-b112-450b-a559-e7acd753a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.073643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982da3a-b112-450b-a559-e7acd753a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.091813 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3982da3a-b112-450b-a559-e7acd753a6c3 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:17.099323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3982da3a-b112-450b-a559-e7acd753a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:17.110187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:17.150688 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1385/2730] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:17.158644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac94da0-61e1-4db3-8ee0-189c77329f87 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.162257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac94da0-61e1-4db3-8ee0-189c77329f87 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.162257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac94da0-61e1-4db3-8ee0-189c77329f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.177535 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1ac94da0-61e1-4db3-8ee0-189c77329f87 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:17.178735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1ac94da0-61e1-4db3-8ee0-189c77329f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:17.186776 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1346/2731] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:17.190956 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982da3a-b112-450b-a559-e7acd753a6c3 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:17.200362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982da3a-b112-450b-a559-e7acd753a6c3 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:17.205468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71036ec6-78c8-487e-b966-6980fd780681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:17.206113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71036ec6-78c8-487e-b966-6980fd780681 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.206398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71036ec6-78c8-487e-b966-6980fd780681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.206676 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71036ec6-78c8-487e-b966-6980fd780681 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.207417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71036ec6-78c8-487e-b966-6980fd780681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:33:17.207736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71036ec6-78c8-487e-b966-6980fd780681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:17.209945 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71036ec6-78c8-487e-b966-6980fd780681 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:17.222143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1386/2732] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:33:17.226153 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac94da0-61e1-4db3-8ee0-189c77329f87 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:17.230585 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:17.235839 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac94da0-61e1-4db3-8ee0-189c77329f87 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:17.240500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4200aa6-dbdb-4bbf-a0ef-1327ed975c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:17.242522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4200aa6-dbdb-4bbf-a0ef-1327ed975c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.242522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4200aa6-dbdb-4bbf-a0ef-1327ed975c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.242522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4200aa6-dbdb-4bbf-a0ef-1327ed975c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.242522 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4200aa6-dbdb-4bbf-a0ef-1327ed975c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:17.244376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4200aa6-dbdb-4bbf-a0ef-1327ed975c0f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:17.345799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1347/2733] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:33:17 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:33:17.349509 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71036ec6-78c8-487e-b966-6980fd780681 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:17.359648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71036ec6-78c8-487e-b966-6980fd780681 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:17.415782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a5e2a-539f-4c6c-ac81-04c5ad78d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:17.416488 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a5e2a-539f-4c6c-ac81-04c5ad78d405 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.416776 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a5e2a-539f-4c6c-ac81-04c5ad78d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.417051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a5e2a-539f-4c6c-ac81-04c5ad78d405 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.417745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a5e2a-539f-4c6c-ac81-04c5ad78d405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:17.419655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a5e2a-539f-4c6c-ac81-04c5ad78d405 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:17.431141 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4200aa6-dbdb-4bbf-a0ef-1327ed975c0f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:17.432861 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d4200aa6-dbdb-4bbf-a0ef-1327ed975c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:17.490014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4200aa6-dbdb-4bbf-a0ef-1327ed975c0f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:17.493660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b634f-208d-4d49-a7ce-94f270414270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:17.494295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b634f-208d-4d49-a7ce-94f270414270 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.494574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b634f-208d-4d49-a7ce-94f270414270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.494847 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b634f-208d-4d49-a7ce-94f270414270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.496610 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-293b634f-208d-4d49-a7ce-94f270414270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:17.507084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1387/2734] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:33:17 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:33:17.511670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a5e2a-539f-4c6c-ac81-04c5ad78d405 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:17.522284 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a5e2a-539f-4c6c-ac81-04c5ad78d405 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:17.526969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e6c53-3f29-4910-a26d-948c0e170235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:17.532996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e6c53-3f29-4910-a26d-948c0e170235 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.532996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e6c53-3f29-4910-a26d-948c0e170235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.532996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e6c53-3f29-4910-a26d-948c0e170235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.532996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e6c53-3f29-4910-a26d-948c0e170235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:17.532996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e6c53-3f29-4910-a26d-948c0e170235 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:17.540302 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1388/2735] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:33:17.544001 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e6c53-3f29-4910-a26d-948c0e170235 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:17.554720 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e6c53-3f29-4910-a26d-948c0e170235 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:17.559933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345ced-2e84-4dcb-9e2a-c189c6a7c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:17.563155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345ced-2e84-4dcb-9e2a-c189c6a7c8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.563155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345ced-2e84-4dcb-9e2a-c189c6a7c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.563155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345ced-2e84-4dcb-9e2a-c189c6a7c8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.563155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc345ced-2e84-4dcb-9e2a-c189c6a7c8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:17.564719 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc345ced-2e84-4dcb-9e2a-c189c6a7c8f0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:17.575537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1389/2736] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:33:17.577859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b634f-208d-4d49-a7ce-94f270414270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:17.580178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345ced-2e84-4dcb-9e2a-c189c6a7c8f0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:17.580362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b634f-208d-4d49-a7ce-94f270414270 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:17.589729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345ced-2e84-4dcb-9e2a-c189c6a7c8f0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:17.591743 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1348/2737] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:33:17.594354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4aaab-7b6e-4905-a305-547a71a48b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:17.595220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4aaab-7b6e-4905-a305-547a71a48b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.595502 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4aaab-7b6e-4905-a305-547a71a48b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.595777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4aaab-7b6e-4905-a305-547a71a48b32 admin admin] PATH_INFO: `/v3/projects/70cf6b4b73da4e5cb936f38f1ad31bf4/users/341edfaa33ca40d2a56613fe59335b67/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.610523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4aaab-7b6e-4905-a305-547a71a48b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cf6b4b73da4e5cb936f38f1ad31bf4, user_id=341edfaa33ca40d2a56613fe59335b67, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:17.613129 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4aaab-7b6e-4905-a305-547a71a48b32 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:17.690434 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1390/2738] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:33:17 2022] PUT /identity/v3/projects/70cf6b4b73da4e5cb936f38f1ad31bf4/users/341edfaa33ca40d2a56613fe59335b67/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:17.700652 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76b0c3-a38f-4415-8741-f07f1d41d44e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.700946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76b0c3-a38f-4415-8741-f07f1d41d44e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.701283 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76b0c3-a38f-4415-8741-f07f1d41d44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.728210 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fb76b0c3-a38f-4415-8741-f07f1d41d44e None None] MFA Rules not processed for user `341edfaa33ca40d2a56613fe59335b67`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:17.729454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fb76b0c3-a38f-4415-8741-f07f1d41d44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:17.794627 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1349/2739] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:17.807854 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4aaab-7b6e-4905-a305-547a71a48b32 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:17.809825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d0a4aaab-7b6e-4905-a305-547a71a48b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:17.869210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4aaab-7b6e-4905-a305-547a71a48b32 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:17.872877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd43e51-fd14-418b-b2f3-cb35aab9013d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:17.873545 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43e51-fd14-418b-b2f3-cb35aab9013d service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:17.873836 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43e51-fd14-418b-b2f3-cb35aab9013d service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:17.874111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43e51-fd14-418b-b2f3-cb35aab9013d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:17.882329 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:17.884963 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd43e51-fd14-418b-b2f3-cb35aab9013d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:17.886451 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd43e51-fd14-418b-b2f3-cb35aab9013d service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:17.896545 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1391/2740] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:20.906911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76b0c3-a38f-4415-8741-f07f1d41d44e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:20.919948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:20.972806 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76b0c3-a38f-4415-8741-f07f1d41d44e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:20.978032 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:20.978996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:20.979209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:20.980993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] PATH_INFO: `/v3/users/341edfaa33ca40d2a56613fe59335b67` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:20.980993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] RBAC: Authorizing `identity:delete_user(user_id=341edfaa33ca40d2a56613fe59335b67)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:20.983253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:21.169710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341edfaa33ca40d2a56613fe59335b67'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:21.177284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341edfaa33ca40d2a56613fe59335b67'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:21.178010 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341edfaa33ca40d2a56613fe59335b67'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:21.196474 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341edfaa33ca40d2a56613fe59335b67'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:21.260807 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341edfaa33ca40d2a56613fe59335b67'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:21.267830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1350/2741] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:33:20 2022] DELETE /identity/v3/users/341edfaa33ca40d2a56613fe59335b67 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:21.272384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a442f5-7385-4540-9934-376810e09532 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:21.272857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a442f5-7385-4540-9934-376810e09532 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:21.273238 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a442f5-7385-4540-9934-376810e09532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:21.291845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f6a442f5-7385-4540-9934-376810e09532 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:21.293078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f6a442f5-7385-4540-9934-376810e09532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:21.352699 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1392/2742] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:21.362845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:21.364248 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:21.420074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2360-9082-4d6f-9be0-ccab7da7564d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:21.424300 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7622bf-03d5-448b-9338-161dc8f62127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:21.424971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7622bf-03d5-448b-9338-161dc8f62127 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:21.425258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7622bf-03d5-448b-9338-161dc8f62127 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:21.425536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7622bf-03d5-448b-9338-161dc8f62127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:21.434687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7622bf-03d5-448b-9338-161dc8f62127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:21.436125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7622bf-03d5-448b-9338-161dc8f62127 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:21.445660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1351/2743] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:21.875539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a442f5-7385-4540-9934-376810e09532 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:21.875539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f6a442f5-7385-4540-9934-376810e09532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:21.886230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a442f5-7385-4540-9934-376810e09532 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:21.891428 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:21.892295 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:21.892607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:21.892918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] PATH_INFO: `/v3/projects/70cf6b4b73da4e5cb936f38f1ad31bf4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:21.897872 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cf6b4b73da4e5cb936f38f1ad31bf4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:21.899725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:22.003281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cf6b4b73da4e5cb936f38f1ad31bf4', 'request_id': 'req-edb65d48-a670-4fd4-8f40-ec812100e502'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:22.089264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cf6b4b73da4e5cb936f38f1ad31bf4', 'request_id': 'req-edb65d48-a670-4fd4-8f40-ec812100e502'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:22.095547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cf6b4b73da4e5cb936f38f1ad31bf4', 'request_id': 'req-edb65d48-a670-4fd4-8f40-ec812100e502'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:22.106859 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] The token cache is being invalidate because project 70cf6b4b73da4e5cb936f38f1ad31bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:33:22.107147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:22.107803 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-edb65d48-a670-4fd4-8f40-ec812100e502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:22.109430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1393/2744] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:33:21 2022] DELETE /identity/v3/projects/70cf6b4b73da4e5cb936f38f1ad31bf4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:22.114372 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3552d64-e9ce-4d66-9339-bc4d1186efa1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.121453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3552d64-e9ce-4d66-9339-bc4d1186efa1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.121453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3552d64-e9ce-4d66-9339-bc4d1186efa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.133286 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f3552d64-e9ce-4d66-9339-bc4d1186efa1 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:22.134483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f3552d64-e9ce-4d66-9339-bc4d1186efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:22.163644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:22.194526 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1352/2745] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:22.203812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f7c5-132e-4e76-9130-f6d021425c88 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.204104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f7c5-132e-4e76-9130-f6d021425c88 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.204417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f7c5-132e-4e76-9130-f6d021425c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.227596 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1fb5f7c5-132e-4e76-9130-f6d021425c88 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:22.229224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1fb5f7c5-132e-4e76-9130-f6d021425c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:22.238118 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1394/2746] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:22.242470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3552d64-e9ce-4d66-9339-bc4d1186efa1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:22.253031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3552d64-e9ce-4d66-9339-bc4d1186efa1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:22.257809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df711640-41b6-4619-8e53-155acc28a44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:22.258396 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df711640-41b6-4619-8e53-155acc28a44f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.258684 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df711640-41b6-4619-8e53-155acc28a44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.259135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df711640-41b6-4619-8e53-155acc28a44f admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.259870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df711640-41b6-4619-8e53-155acc28a44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:33:22.260179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df711640-41b6-4619-8e53-155acc28a44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:22.261893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df711640-41b6-4619-8e53-155acc28a44f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:22.277090 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1353/2747] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:33:22.278210 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5f7c5-132e-4e76-9130-f6d021425c88 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:22.287683 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5f7c5-132e-4e76-9130-f6d021425c88 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:22.293148 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded6134-2c34-4826-9726-350edf17a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:22.293844 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded6134-2c34-4826-9726-350edf17a836 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.294128 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded6134-2c34-4826-9726-350edf17a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.294401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded6134-2c34-4826-9726-350edf17a836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.295081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded6134-2c34-4826-9726-350edf17a836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:22.297621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded6134-2c34-4826-9726-350edf17a836 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:22.393847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1395/2748] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:33:22 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:33:22.397804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df711640-41b6-4619-8e53-155acc28a44f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:22.408144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df711640-41b6-4619-8e53-155acc28a44f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:22.464222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98916945-fd61-41af-9a96-052599d7cb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:22.465018 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916945-fd61-41af-9a96-052599d7cb02 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.465309 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916945-fd61-41af-9a96-052599d7cb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.465589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916945-fd61-41af-9a96-052599d7cb02 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.466282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98916945-fd61-41af-9a96-052599d7cb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:22.468217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98916945-fd61-41af-9a96-052599d7cb02 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:22.552893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1354/2749] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:33:22 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:33:22.557011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded6134-2c34-4826-9726-350edf17a836 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:22.567763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded6134-2c34-4826-9726-350edf17a836 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:22.572615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd35e0-da7e-43e0-8bae-0b7fdc5a7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:22.573265 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd35e0-da7e-43e0-8bae-0b7fdc5a7437 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.573643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd35e0-da7e-43e0-8bae-0b7fdc5a7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.573860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd35e0-da7e-43e0-8bae-0b7fdc5a7437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.574567 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd35e0-da7e-43e0-8bae-0b7fdc5a7437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:22.576137 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd35e0-da7e-43e0-8bae-0b7fdc5a7437 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:22.586610 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1396/2750] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:33:22.590430 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98916945-fd61-41af-9a96-052599d7cb02 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:22.600883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98916945-fd61-41af-9a96-052599d7cb02 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:22.605845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1928dd1-4386-40a8-a332-186ca2e0011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:22.609217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1928dd1-4386-40a8-a332-186ca2e0011a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.609217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1928dd1-4386-40a8-a332-186ca2e0011a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.609217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1928dd1-4386-40a8-a332-186ca2e0011a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.609217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1928dd1-4386-40a8-a332-186ca2e0011a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:22.610342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1928dd1-4386-40a8-a332-186ca2e0011a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:22.621312 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1355/2751] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:33:22.625772 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd35e0-da7e-43e0-8bae-0b7fdc5a7437 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:22.637709 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd35e0-da7e-43e0-8bae-0b7fdc5a7437 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:22.643262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866698-a2c0-48ef-9053-c8789ca6718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:22.644189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866698-a2c0-48ef-9053-c8789ca6718f admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.644536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866698-a2c0-48ef-9053-c8789ca6718f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.644823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866698-a2c0-48ef-9053-c8789ca6718f admin admin] PATH_INFO: `/v3/projects/993c5f890fa84dd7ab6581893a508bb7/users/ad7a4c0c24b34e769a41b1df676519d2/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.661083 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7866698-a2c0-48ef-9053-c8789ca6718f admin admin] RBAC: Authorizing `identity:create_grant(project_id=993c5f890fa84dd7ab6581893a508bb7, user_id=ad7a4c0c24b34e769a41b1df676519d2, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:22.663777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7866698-a2c0-48ef-9053-c8789ca6718f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:22.717715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1397/2752] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:33:22 2022] PUT /identity/v3/projects/993c5f890fa84dd7ab6581893a508bb7/users/ad7a4c0c24b34e769a41b1df676519d2/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:33:22.728253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c37117-63f0-4dd8-aa03-5466924db8c8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.728591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c37117-63f0-4dd8-aa03-5466924db8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.728867 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c37117-63f0-4dd8-aa03-5466924db8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.755591 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b1c37117-63f0-4dd8-aa03-5466924db8c8 None None] MFA Rules not processed for user `ad7a4c0c24b34e769a41b1df676519d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:22.756959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b1c37117-63f0-4dd8-aa03-5466924db8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:22.825219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1356/2753] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:22.835555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866698-a2c0-48ef-9053-c8789ca6718f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:22.837248 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c7866698-a2c0-48ef-9053-c8789ca6718f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:22.855801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:22.893322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866698-a2c0-48ef-9053-c8789ca6718f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:22.896894 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d8054-e75b-4a9e-b585-016aff6c0df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:22.897527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d8054-e75b-4a9e-b585-016aff6c0df9 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:22.897810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d8054-e75b-4a9e-b585-016aff6c0df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:22.900384 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d8054-e75b-4a9e-b585-016aff6c0df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:22.906666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d8054-e75b-4a9e-b585-016aff6c0df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:22.908070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d8054-e75b-4a9e-b585-016aff6c0df9 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:22.917957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1398/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:30.422180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87039fa-ece9-409b-a508-9d44b8d4c8cb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:30.422679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87039fa-ece9-409b-a508-9d44b8d4c8cb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:30.422679 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87039fa-ece9-409b-a508-9d44b8d4c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:30.441285 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c87039fa-ece9-409b-a508-9d44b8d4c8cb None None] MFA Rules not processed for user `2fdd0ca923f844dc92d769f25f366d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:30.442483 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c87039fa-ece9-409b-a508-9d44b8d4c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:30.467377 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:30.499618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1357/2755] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:31.181639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d8054-e75b-4a9e-b585-016aff6c0df9 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:31.183351 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f29d8054-e75b-4a9e-b585-016aff6c0df9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:31.252639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d8054-e75b-4a9e-b585-016aff6c0df9 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:31.257544 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105841ea-39cf-47a0-b985-4d14a36441d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:31.258187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105841ea-39cf-47a0-b985-4d14a36441d7 service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:31.258470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105841ea-39cf-47a0-b985-4d14a36441d7 service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:31.258745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105841ea-39cf-47a0-b985-4d14a36441d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:31.260511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-105841ea-39cf-47a0-b985-4d14a36441d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:31.272050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105841ea-39cf-47a0-b985-4d14a36441d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:31.273643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105841ea-39cf-47a0-b985-4d14a36441d7 service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:31.283873 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1399/2756] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:33:34.149351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87039fa-ece9-409b-a508-9d44b8d4c8cb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:34.150946 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c87039fa-ece9-409b-a508-9d44b8d4c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:34.212066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87039fa-ece9-409b-a508-9d44b8d4c8cb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:34.216188 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ca44a-96c7-4508-92f1-6b14d9181a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:34.216874 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ca44a-96c7-4508-92f1-6b14d9181a9e service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:34.217193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ca44a-96c7-4508-92f1-6b14d9181a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:34.218108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ca44a-96c7-4508-92f1-6b14d9181a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:34.220099 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-233ca44a-96c7-4508-92f1-6b14d9181a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:34.230916 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ca44a-96c7-4508-92f1-6b14d9181a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:34.232395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ca44a-96c7-4508-92f1-6b14d9181a9e service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:34.241101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1358/2757] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:34.357354 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105841ea-39cf-47a0-b985-4d14a36441d7 service placement] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:34.419933 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105841ea-39cf-47a0-b985-4d14a36441d7 service placement] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:34.424530 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:34.425805 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:34.426085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:34.426480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] PATH_INFO: `/v3/users/ad7a4c0c24b34e769a41b1df676519d2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:34.427663 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7a4c0c24b34e769a41b1df676519d2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:34.429607 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:34.612580 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7a4c0c24b34e769a41b1df676519d2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:34.613245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7a4c0c24b34e769a41b1df676519d2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:34.615333 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:34.620706 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7a4c0c24b34e769a41b1df676519d2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:34.621421 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7a4c0c24b34e769a41b1df676519d2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:34.634660 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7a4c0c24b34e769a41b1df676519d2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:34.717747 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1400/2758] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:33:34 2022] DELETE /identity/v3/users/ad7a4c0c24b34e769a41b1df676519d2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:34.722889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8eb56-0b26-43f6-9b38-75b4e9c88cb3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:34.723179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8eb56-0b26-43f6-9b38-75b4e9c88cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:34.723471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8eb56-0b26-43f6-9b38-75b4e9c88cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:34.740845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-96d8eb56-0b26-43f6-9b38-75b4e9c88cb3 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:34.742021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-96d8eb56-0b26-43f6-9b38-75b4e9c88cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:34.799473 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1359/2759] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:34.809385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:34.810820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:34.870006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013aba0b-44d4-42b1-af97-42d97dbe967a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:34.873992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2c53e-9f6b-4271-9b45-67420c8d16cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:34.874655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2c53e-9f6b-4271-9b45-67420c8d16cd service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:34.874984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2c53e-9f6b-4271-9b45-67420c8d16cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:34.875259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2c53e-9f6b-4271-9b45-67420c8d16cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:34.885789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2c53e-9f6b-4271-9b45-67420c8d16cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:34.887037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2c53e-9f6b-4271-9b45-67420c8d16cd service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:34.898902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1401/2760] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:35.495770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8eb56-0b26-43f6-9b38-75b4e9c88cb3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:35.497222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-96d8eb56-0b26-43f6-9b38-75b4e9c88cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:35.512426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8eb56-0b26-43f6-9b38-75b4e9c88cb3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:35.518626 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:35.519891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:35.520562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:35.521055 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] PATH_INFO: `/v3/projects/993c5f890fa84dd7ab6581893a508bb7` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:35.522349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=993c5f890fa84dd7ab6581893a508bb7)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:35.524253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:35.616409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '993c5f890fa84dd7ab6581893a508bb7', 'request_id': 'req-af64bee8-519e-49d4-a475-265b14ce9cc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:35.730340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '993c5f890fa84dd7ab6581893a508bb7', 'request_id': 'req-af64bee8-519e-49d4-a475-265b14ce9cc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:35.738012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '993c5f890fa84dd7ab6581893a508bb7', 'request_id': 'req-af64bee8-519e-49d4-a475-265b14ce9cc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:35.745634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:35.749600 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] The token cache is being invalidate because project 993c5f890fa84dd7ab6581893a508bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:33:35.749889 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:35.750578 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-af64bee8-519e-49d4-a475-265b14ce9cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:33:35.752348 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1360/2761] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:33:35 2022] DELETE /identity/v3/projects/993c5f890fa84dd7ab6581893a508bb7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:35.757980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039a0c-a517-4538-b16c-736b9e3f5fad None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:35.759721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039a0c-a517-4538-b16c-736b9e3f5fad None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:35.759721 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039a0c-a517-4538-b16c-736b9e3f5fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:35.777825 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-03039a0c-a517-4538-b16c-736b9e3f5fad None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:35.779097 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-03039a0c-a517-4538-b16c-736b9e3f5fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:35.849750 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1402/2762] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:35.857593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe93ef-b898-4ffe-ba6a-599e35705fee None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:35.857887 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe93ef-b898-4ffe-ba6a-599e35705fee None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:35.858195 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe93ef-b898-4ffe-ba6a-599e35705fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:35.876761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5afe93ef-b898-4ffe-ba6a-599e35705fee None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:35.878575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5afe93ef-b898-4ffe-ba6a-599e35705fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:35.886557 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1361/2763] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:35.890808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039a0c-a517-4538-b16c-736b9e3f5fad None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:35.901561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039a0c-a517-4538-b16c-736b9e3f5fad None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:35.906328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d250984-cf09-4cff-8fab-1fdc869e9e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:35.906999 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d250984-cf09-4cff-8fab-1fdc869e9e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:35.907313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d250984-cf09-4cff-8fab-1fdc869e9e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:35.907593 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d250984-cf09-4cff-8fab-1fdc869e9e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:35.908360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d250984-cf09-4cff-8fab-1fdc869e9e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:33:35.908695 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d250984-cf09-4cff-8fab-1fdc869e9e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:35.910363 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d250984-cf09-4cff-8fab-1fdc869e9e72 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:35.922328 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1403/2764] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:33:35.926458 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe93ef-b898-4ffe-ba6a-599e35705fee None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:35.935701 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe93ef-b898-4ffe-ba6a-599e35705fee None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:35.941116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded11db-3e95-45d1-b385-f8f243e76aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:35.941764 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded11db-3e95-45d1-b385-f8f243e76aba admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:35.942043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded11db-3e95-45d1-b385-f8f243e76aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:35.942313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded11db-3e95-45d1-b385-f8f243e76aba admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:35.943004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded11db-3e95-45d1-b385-f8f243e76aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:35.945042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded11db-3e95-45d1-b385-f8f243e76aba admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:36.040928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1362/2765] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:33:35 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:33:36.047456 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d250984-cf09-4cff-8fab-1fdc869e9e72 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:36.064809 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d250984-cf09-4cff-8fab-1fdc869e9e72 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:36.123038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:36.129673 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cb80d-7fb8-4b62-8152-39a969cf0eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:36.130357 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cb80d-7fb8-4b62-8152-39a969cf0eef admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:36.130637 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cb80d-7fb8-4b62-8152-39a969cf0eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:36.130911 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cb80d-7fb8-4b62-8152-39a969cf0eef admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:36.131771 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cb80d-7fb8-4b62-8152-39a969cf0eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:36.133830 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cb80d-7fb8-4b62-8152-39a969cf0eef admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:36.266564 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1404/2766] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:33:36 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:33:36.271380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded11db-3e95-45d1-b385-f8f243e76aba admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:36.282340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded11db-3e95-45d1-b385-f8f243e76aba admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:36.287256 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35b9b-104d-402a-a7e1-3cecf16984ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:36.288521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35b9b-104d-402a-a7e1-3cecf16984ae admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:36.288521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35b9b-104d-402a-a7e1-3cecf16984ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:36.288763 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35b9b-104d-402a-a7e1-3cecf16984ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:36.289393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35b9b-104d-402a-a7e1-3cecf16984ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:36.291084 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35b9b-104d-402a-a7e1-3cecf16984ae admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:36.302116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1363/2767] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:33:36.306089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cb80d-7fb8-4b62-8152-39a969cf0eef admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:36.317252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cb80d-7fb8-4b62-8152-39a969cf0eef admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:36.321974 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70f7c4-e9af-4118-ba34-3d87d3905b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:36.327657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f7c4-e9af-4118-ba34-3d87d3905b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:36.327657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f7c4-e9af-4118-ba34-3d87d3905b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:36.327657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f7c4-e9af-4118-ba34-3d87d3905b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:36.327657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70f7c4-e9af-4118-ba34-3d87d3905b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:36.327657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70f7c4-e9af-4118-ba34-3d87d3905b89 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:36.335817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1405/2768] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:33:36.340110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35b9b-104d-402a-a7e1-3cecf16984ae admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:36.350159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35b9b-104d-402a-a7e1-3cecf16984ae admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:36.356364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5afd64-a6bc-4b82-8997-301cfc13da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:36.356364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5afd64-a6bc-4b82-8997-301cfc13da46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:36.356364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5afd64-a6bc-4b82-8997-301cfc13da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:36.356364 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5afd64-a6bc-4b82-8997-301cfc13da46 admin admin] PATH_INFO: `/v3/projects/45cfe981eb124baba9a0dd679eea36ee/users/85778df2ce7b4e6696e2ffe163d47aca/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:36.371577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5afd64-a6bc-4b82-8997-301cfc13da46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cfe981eb124baba9a0dd679eea36ee, user_id=85778df2ce7b4e6696e2ffe163d47aca, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:36.374323 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5afd64-a6bc-4b82-8997-301cfc13da46 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:36.483031 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1364/2769] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:33:36 2022] PUT /identity/v3/projects/45cfe981eb124baba9a0dd679eea36ee/users/85778df2ce7b4e6696e2ffe163d47aca/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:36.488768 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810836-95e2-4958-a582-353ae278b52d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:36.489065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810836-95e2-4958-a582-353ae278b52d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:36.489346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810836-95e2-4958-a582-353ae278b52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:36.507823 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a5810836-95e2-4958-a582-353ae278b52d None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:36.511139 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a5810836-95e2-4958-a582-353ae278b52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:36.567359 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1406/2770] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:36.577000 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5afd64-a6bc-4b82-8997-301cfc13da46 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:36.578781 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-aa5afd64-a6bc-4b82-8997-301cfc13da46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:36.636051 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5afd64-a6bc-4b82-8997-301cfc13da46 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:36.639696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390355a-6c81-4145-8c72-13dc8b68a5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:36.640351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390355a-6c81-4145-8c72-13dc8b68a5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:36.640637 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390355a-6c81-4145-8c72-13dc8b68a5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:36.640909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390355a-6c81-4145-8c72-13dc8b68a5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:36.650794 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390355a-6c81-4145-8c72-13dc8b68a5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:36.651640 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390355a-6c81-4145-8c72-13dc8b68a5d3 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:36.662157 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1365/2771] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:33:41.819861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b12fc-7548-4a5a-8434-1ad87ed3455e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:41.820429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b12fc-7548-4a5a-8434-1ad87ed3455e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:41.820657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b12fc-7548-4a5a-8434-1ad87ed3455e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:41.852742 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-432b12fc-7548-4a5a-8434-1ad87ed3455e None None] MFA Rules not processed for user `85778df2ce7b4e6696e2ffe163d47aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:41.854084 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-432b12fc-7548-4a5a-8434-1ad87ed3455e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:41.960789 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1407/2772] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:41.962735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390355a-6c81-4145-8c72-13dc8b68a5d3 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:41.974366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390355a-6c81-4145-8c72-13dc8b68a5d3 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:41.980044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a6f25-041a-4a94-a78b-698a67e63fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:41.980951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6f25-041a-4a94-a78b-698a67e63fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:41.981456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6f25-041a-4a94-a78b-698a67e63fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:41.981910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6f25-041a-4a94-a78b-698a67e63fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:41.982739 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a6f25-041a-4a94-a78b-698a67e63fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:41.985242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a6f25-041a-4a94-a78b-698a67e63fb4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:42.073354 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1366/2773] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:33:41 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:33:42.083252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b12fc-7548-4a5a-8434-1ad87ed3455e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:42.091704 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b12fc-7548-4a5a-8434-1ad87ed3455e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:42.150982 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101444d-83dd-4898-9230-aec88dcaff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:42.151659 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101444d-83dd-4898-9230-aec88dcaff1f admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:42.151946 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101444d-83dd-4898-9230-aec88dcaff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:42.152228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101444d-83dd-4898-9230-aec88dcaff1f admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:42.152950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101444d-83dd-4898-9230-aec88dcaff1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:42.154865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101444d-83dd-4898-9230-aec88dcaff1f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:42.164943 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:42.242773 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1408/2774] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:33:42 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:33:42.246826 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a6f25-041a-4a94-a78b-698a67e63fb4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:42.257110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a6f25-041a-4a94-a78b-698a67e63fb4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:42.261738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fe110-4474-424c-8ea2-a57e268dab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:42.262393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fe110-4474-424c-8ea2-a57e268dab85 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:42.262680 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fe110-4474-424c-8ea2-a57e268dab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:42.262962 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fe110-4474-424c-8ea2-a57e268dab85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:42.263690 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fe110-4474-424c-8ea2-a57e268dab85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:42.265339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fe110-4474-424c-8ea2-a57e268dab85 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:42.276271 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1367/2775] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:33:42.280198 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101444d-83dd-4898-9230-aec88dcaff1f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:42.290751 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101444d-83dd-4898-9230-aec88dcaff1f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:42.295601 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc7fb2-0926-4e65-9345-58723992f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:42.296526 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc7fb2-0926-4e65-9345-58723992f0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:42.296808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc7fb2-0926-4e65-9345-58723992f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:42.297078 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc7fb2-0926-4e65-9345-58723992f0ee admin admin] PATH_INFO: `/v3/projects/a1897b8d2dec4070b1b093c0a65be862/users/d7e101e62eca400688363b5fb58f19a4/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:42.312648 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc7fb2-0926-4e65-9345-58723992f0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1897b8d2dec4070b1b093c0a65be862, user_id=d7e101e62eca400688363b5fb58f19a4, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:42.315338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc7fb2-0926-4e65-9345-58723992f0ee admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:42.397863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1409/2776] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:33:42 2022] PUT /identity/v3/projects/a1897b8d2dec4070b1b093c0a65be862/users/d7e101e62eca400688363b5fb58f19a4/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:42.401859 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fe110-4474-424c-8ea2-a57e268dab85 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:42.411819 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fe110-4474-424c-8ea2-a57e268dab85 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:42.468711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45214d3b-c6cc-42d7-8da8-0752b3d7d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:42.469380 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45214d3b-c6cc-42d7-8da8-0752b3d7d4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:42.469661 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45214d3b-c6cc-42d7-8da8-0752b3d7d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:42.469936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45214d3b-c6cc-42d7-8da8-0752b3d7d4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:42.470651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45214d3b-c6cc-42d7-8da8-0752b3d7d4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:42.472243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45214d3b-c6cc-42d7-8da8-0752b3d7d4ea admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:42.481934 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1368/2777] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:33:42.485985 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc7fb2-0926-4e65-9345-58723992f0ee admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:42.496400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc7fb2-0926-4e65-9345-58723992f0ee admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:42.501427 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9dc84-e8cb-48b6-b9cc-41187f491d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:42.502904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9dc84-e8cb-48b6-b9cc-41187f491d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:42.503190 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9dc84-e8cb-48b6-b9cc-41187f491d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:42.503465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9dc84-e8cb-48b6-b9cc-41187f491d15 admin admin] PATH_INFO: `/v3/projects/a1897b8d2dec4070b1b093c0a65be862/users/d7e101e62eca400688363b5fb58f19a4/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:42.505501 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9dc84-e8cb-48b6-b9cc-41187f491d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1897b8d2dec4070b1b093c0a65be862, user_id=d7e101e62eca400688363b5fb58f19a4, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:42.508173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9dc84-e8cb-48b6-b9cc-41187f491d15 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:42.519863 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1410/2778] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:33:42 2022] PUT /identity/v3/projects/a1897b8d2dec4070b1b093c0a65be862/users/d7e101e62eca400688363b5fb58f19a4/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:33:46.805823 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45214d3b-c6cc-42d7-8da8-0752b3d7d4ea admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:46.809056 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-45214d3b-c6cc-42d7-8da8-0752b3d7d4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:46.815393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:33:46.909738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45214d3b-c6cc-42d7-8da8-0752b3d7d4ea admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:46.999024 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:46.999761 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:47.000203 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:47.000571 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:47.003222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:47.022342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:47.024093 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:47.042445 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1369/2779] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:49.534249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b520-071e-48a1-8c48-9b552e08639c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:49.537939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b520-071e-48a1-8c48-9b552e08639c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:49.537939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b520-071e-48a1-8c48-9b552e08639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:49.562642 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4a98b520-071e-48a1-8c48-9b552e08639c None None] MFA Rules not processed for user `d7e101e62eca400688363b5fb58f19a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:49.563788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4a98b520-071e-48a1-8c48-9b552e08639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:49.633655 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1411/2780] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:33:49.647328 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:33:49.648795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:49.662494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddaca9-cc21-4eeb-926c-bd6964ddd681 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:33:49.667980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125765bb-9458-44ee-b362-0624a1fecbcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:33:49.668676 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125765bb-9458-44ee-b362-0624a1fecbcb service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:49.668964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125765bb-9458-44ee-b362-0624a1fecbcb service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:49.669242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125765bb-9458-44ee-b362-0624a1fecbcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:49.726330 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125765bb-9458-44ee-b362-0624a1fecbcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:33:49.727849 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125765bb-9458-44ee-b362-0624a1fecbcb service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:33:49.737586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1370/2781] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:33:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:33:52.185050 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd746e61-188d-4d1a-ba92-8b98d986f664 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:33:52.185592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd746e61-188d-4d1a-ba92-8b98d986f664 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:33:52.185592 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd746e61-188d-4d1a-ba92-8b98d986f664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:33:52.204800 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bd746e61-188d-4d1a-ba92-8b98d986f664 None None] MFA Rules not processed for user `85778df2ce7b4e6696e2ffe163d47aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:33:52.206887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bd746e61-188d-4d1a-ba92-8b98d986f664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:33:52.214027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1412/2782] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:33:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 03:33:59.732733 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:34:02.199218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:34:11.167101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125765bb-9458-44ee-b362-0624a1fecbcb service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:34:11.168572 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-125765bb-9458-44ee-b362-0624a1fecbcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:34:11.224734 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125765bb-9458-44ee-b362-0624a1fecbcb service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:34:11.228243 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6c384-a656-4ef3-871f-e2cbb3d47844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:34:11.228908 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6c384-a656-4ef3-871f-e2cbb3d47844 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:34:11.229194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6c384-a656-4ef3-871f-e2cbb3d47844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:34:11.229470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6c384-a656-4ef3-871f-e2cbb3d47844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:34:11.231224 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-75c6c384-a656-4ef3-871f-e2cbb3d47844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:34:11.241037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6c384-a656-4ef3-871f-e2cbb3d47844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:34:11.242465 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6c384-a656-4ef3-871f-e2cbb3d47844 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:34:11.250374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1371/2783] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:34:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:34:21.246815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=26 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:34:25.677923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd746e61-188d-4d1a-ba92-8b98d986f664 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:34:25.690736 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd746e61-188d-4d1a-ba92-8b98d986f664 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:34:25.697239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c051d47-d503-4068-9dd3-276f922db52e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:34:25.704995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c051d47-d503-4068-9dd3-276f922db52e service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:34:25.704995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c051d47-d503-4068-9dd3-276f922db52e service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:34:25.704995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c051d47-d503-4068-9dd3-276f922db52e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:34:25.704995 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7c051d47-d503-4068-9dd3-276f922db52e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:34:25.713160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c051d47-d503-4068-9dd3-276f922db52e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:34:25.714812 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c051d47-d503-4068-9dd3-276f922db52e service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:34:25.725578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1413/2784] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:34:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:34:29.322651 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6c384-a656-4ef3-871f-e2cbb3d47844 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:34:29.331375 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6c384-a656-4ef3-871f-e2cbb3d47844 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:34:29.334936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f4845-35bd-44ba-9307-d922b37492b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:34:29.335562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f4845-35bd-44ba-9307-d922b37492b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:34:29.335845 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f4845-35bd-44ba-9307-d922b37492b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:34:29.336122 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f4845-35bd-44ba-9307-d922b37492b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:34:29.344891 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f4845-35bd-44ba-9307-d922b37492b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:34:29.346329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f4845-35bd-44ba-9307-d922b37492b3 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:34:29.356074 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1372/2785] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:34:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:34:35.721119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=6 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:34:39.351912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:35:02.017514 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c051d47-d503-4068-9dd3-276f922db52e service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:35:02.065520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c051d47-d503-4068-9dd3-276f922db52e service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:35:02.070969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8be43-403f-442b-a0bf-f3f515516d14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:35:02.072447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8be43-403f-442b-a0bf-f3f515516d14 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:35:02.072603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8be43-403f-442b-a0bf-f3f515516d14 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:35:02.072895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8be43-403f-442b-a0bf-f3f515516d14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:35:02.074672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5cb8be43-403f-442b-a0bf-f3f515516d14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:35:02.140629 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8be43-403f-442b-a0bf-f3f515516d14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:35:02.142207 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8be43-403f-442b-a0bf-f3f515516d14 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:35:02.151257 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1414/2786] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:35:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:35:12.146980 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=49 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:35:17.664216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860444b6-037b-4f12-9e44-e75851bbaac9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:35:17.669997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860444b6-037b-4f12-9e44-e75851bbaac9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:35:17.669997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860444b6-037b-4f12-9e44-e75851bbaac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:35:17.682194 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-860444b6-037b-4f12-9e44-e75851bbaac9 None None] MFA Rules not processed for user `2fdd0ca923f844dc92d769f25f366d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:35:17.683398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-860444b6-037b-4f12-9e44-e75851bbaac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:35:17.690271 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1373/2787] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:35:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:35:17.989289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8be43-403f-442b-a0bf-f3f515516d14 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:35:18.017143 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8be43-403f-442b-a0bf-f3f515516d14 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:35:18.020740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aaa87-6de1-4009-9f76-0f22c5b1d7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:35:18.021372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aaa87-6de1-4009-9f76-0f22c5b1d7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:35:18.021651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aaa87-6de1-4009-9f76-0f22c5b1d7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:35:18.021922 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aaa87-6de1-4009-9f76-0f22c5b1d7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:35:18.023668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-387aaa87-6de1-4009-9f76-0f22c5b1d7f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:35:18.045608 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aaa87-6de1-4009-9f76-0f22c5b1d7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:35:18.047015 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aaa87-6de1-4009-9f76-0f22c5b1d7f4 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:35:18.054855 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1415/2788] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:35:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:35:27.677108 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:35:28.051298 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=18 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:36:58.266939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860444b6-037b-4f12-9e44-e75851bbaac9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:36:58.268658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-860444b6-037b-4f12-9e44-e75851bbaac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:36:58.359408 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860444b6-037b-4f12-9e44-e75851bbaac9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:36:58.364405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9922b-d225-4bdb-84dc-cdf1960cfebe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:36:58.365047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9922b-d225-4bdb-84dc-cdf1960cfebe service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:36:58.365332 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9922b-d225-4bdb-84dc-cdf1960cfebe service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:36:58.365607 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9922b-d225-4bdb-84dc-cdf1960cfebe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:36:58.367388 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c6b9922b-d225-4bdb-84dc-cdf1960cfebe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:36:58.378677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9922b-d225-4bdb-84dc-cdf1960cfebe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:36:58.380249 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9922b-d225-4bdb-84dc-cdf1960cfebe service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:36:58.390017 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1374/2789] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:36:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:05.293665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aaa87-6de1-4009-9f76-0f22c5b1d7f4 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:05.302289 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aaa87-6de1-4009-9f76-0f22c5b1d7f4 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:05.306177 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:05.307323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:05.307602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:05.307874 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:05.309626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:05.395441 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:05.396913 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:05.415126 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1416/2790] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:08.385835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=41 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:08.864252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9922b-d225-4bdb-84dc-cdf1960cfebe service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:08.875523 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9922b-d225-4bdb-84dc-cdf1960cfebe service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:08.881556 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0079f59-44b9-4142-96d8-d3b0f75ce783 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:08.882284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0079f59-44b9-4142-96d8-d3b0f75ce783 service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:08.882644 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0079f59-44b9-4142-96d8-d3b0f75ce783 service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:08.882994 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0079f59-44b9-4142-96d8-d3b0f75ce783 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:08.885323 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f0079f59-44b9-4142-96d8-d3b0f75ce783 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:08.897434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0079f59-44b9-4142-96d8-d3b0f75ce783 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:08.899265 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0079f59-44b9-4142-96d8-d3b0f75ce783 service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:08.910995 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1375/2791] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:09.008091 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:09.009722 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:09.023221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af83b6-031b-4a08-8d13-7625ea3dee2b service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:09.028404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:09.029275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:09.029586 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:09.029861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] PATH_INFO: `/v3/users/2fdd0ca923f844dc92d769f25f366d13` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:09.031030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fdd0ca923f844dc92d769f25f366d13)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:09.032997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:09.180288 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fdd0ca923f844dc92d769f25f366d13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.180979 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fdd0ca923f844dc92d769f25f366d13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.187744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fdd0ca923f844dc92d769f25f366d13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.188429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fdd0ca923f844dc92d769f25f366d13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.200939 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0a648aab-d9e9-4f4d-a26e-f30ea2d5fe81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fdd0ca923f844dc92d769f25f366d13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.287396 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1417/2792] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:09 2022] DELETE /identity/v3/users/2fdd0ca923f844dc92d769f25f366d13 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:09.580898 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0079f59-44b9-4142-96d8-d3b0f75ce783 service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:09.591566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0079f59-44b9-4142-96d8-d3b0f75ce783 service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:09.658605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:09.659467 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:09.659748 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:09.660021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] PATH_INFO: `/v3/projects/aab4f98c3f8f41abad705003d15e1de6` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:09.661233 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab4f98c3f8f41abad705003d15e1de6)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:09.663111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:09.815258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab4f98c3f8f41abad705003d15e1de6', 'request_id': 'req-502e7ccc-1594-4faa-91c4-be85fbc5c16a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.899369 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab4f98c3f8f41abad705003d15e1de6', 'request_id': 'req-502e7ccc-1594-4faa-91c4-be85fbc5c16a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.906399 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab4f98c3f8f41abad705003d15e1de6', 'request_id': 'req-502e7ccc-1594-4faa-91c4-be85fbc5c16a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.917974 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] The token cache is being invalidate because project aab4f98c3f8f41abad705003d15e1de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:09.918264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.918921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-502e7ccc-1594-4faa-91c4-be85fbc5c16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:09.920545 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1376/2793] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:09 2022] DELETE /identity/v3/projects/aab4f98c3f8f41abad705003d15e1de6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:09.925401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d81679-df71-49c7-9753-7f8e90e24f43 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:09.925689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d81679-df71-49c7-9753-7f8e90e24f43 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:09.925966 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d81679-df71-49c7-9753-7f8e90e24f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:09.979208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:09.981866 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-52d81679-df71-49c7-9753-7f8e90e24f43 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:09.983105 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-52d81679-df71-49c7-9753-7f8e90e24f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:10.041230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1418/2794] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:10.049872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356d697-4c3c-4035-8f11-b31e2acae793 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:10.050160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356d697-4c3c-4035-8f11-b31e2acae793 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:10.050438 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356d697-4c3c-4035-8f11-b31e2acae793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:10.069096 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6356d697-4c3c-4035-8f11-b31e2acae793 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:10.070348 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6356d697-4c3c-4035-8f11-b31e2acae793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:10.078034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1377/2795] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:10.096796 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d81679-df71-49c7-9753-7f8e90e24f43 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:10.107477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d81679-df71-49c7-9753-7f8e90e24f43 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:10.112107 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb955-aa98-4c29-8898-58ecdf692ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:10.112790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb955-aa98-4c29-8898-58ecdf692ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:10.113072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb955-aa98-4c29-8898-58ecdf692ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:10.116178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb955-aa98-4c29-8898-58ecdf692ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:10.116178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bb955-aa98-4c29-8898-58ecdf692ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:37:10.116178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bb955-aa98-4c29-8898-58ecdf692ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:10.116178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bb955-aa98-4c29-8898-58ecdf692ff9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:10.128360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1419/2796] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:37:10.132360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356d697-4c3c-4035-8f11-b31e2acae793 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:10.141485 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356d697-4c3c-4035-8f11-b31e2acae793 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:10.146173 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f3d45-9dfb-48a4-87ae-b7c62180b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:10.146812 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f3d45-9dfb-48a4-87ae-b7c62180b283 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:10.147107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f3d45-9dfb-48a4-87ae-b7c62180b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:10.147368 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f3d45-9dfb-48a4-87ae-b7c62180b283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:10.148040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f3d45-9dfb-48a4-87ae-b7c62180b283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:10.150107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f3d45-9dfb-48a4-87ae-b7c62180b283 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:10.250107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1378/2797] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:10 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:10.254049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb955-aa98-4c29-8898-58ecdf692ff9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:10.263860 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb955-aa98-4c29-8898-58ecdf692ff9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:10.318399 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5fe9a-b298-4998-8c8c-6bc874256c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:10.319061 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5fe9a-b298-4998-8c8c-6bc874256c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:10.319346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5fe9a-b298-4998-8c8c-6bc874256c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:10.319622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5fe9a-b298-4998-8c8c-6bc874256c38 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:10.320296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5fe9a-b298-4998-8c8c-6bc874256c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:10.322228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5fe9a-b298-4998-8c8c-6bc874256c38 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:10.440285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1420/2798] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:10 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:10.441530 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f3d45-9dfb-48a4-87ae-b7c62180b283 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:10.451820 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f3d45-9dfb-48a4-87ae-b7c62180b283 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:10.456618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc9490-23e2-4f48-bb84-641ad8816731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:10.457282 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc9490-23e2-4f48-bb84-641ad8816731 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:10.457566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc9490-23e2-4f48-bb84-641ad8816731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:10.457878 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc9490-23e2-4f48-bb84-641ad8816731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:10.458596 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc9490-23e2-4f48-bb84-641ad8816731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:10.460219 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc9490-23e2-4f48-bb84-641ad8816731 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:10.473023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1379/2799] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:10.479505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5fe9a-b298-4998-8c8c-6bc874256c38 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:10.490335 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5fe9a-b298-4998-8c8c-6bc874256c38 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:10.495071 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e0b52-f2e1-4b00-aa04-5f27e72be4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:10.495788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e0b52-f2e1-4b00-aa04-5f27e72be4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:10.496073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e0b52-f2e1-4b00-aa04-5f27e72be4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:10.496377 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e0b52-f2e1-4b00-aa04-5f27e72be4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:10.497285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e0b52-f2e1-4b00-aa04-5f27e72be4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:10.499178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e0b52-f2e1-4b00-aa04-5f27e72be4e9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:10.510104 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1421/2800] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:10.514071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc9490-23e2-4f48-bb84-641ad8816731 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:10.523933 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc9490-23e2-4f48-bb84-641ad8816731 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:10.529222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92bff7-b18a-40f6-9701-2608ce8c42c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:10.533423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92bff7-b18a-40f6-9701-2608ce8c42c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:10.533423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92bff7-b18a-40f6-9701-2608ce8c42c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:10.533423 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92bff7-b18a-40f6-9701-2608ce8c42c0 admin admin] PATH_INFO: `/v3/projects/cb66fee5a4dc45c58728b8c00ecd351c/users/d58972317fda4bea94f935d0a4785854/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:10.546434 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92bff7-b18a-40f6-9701-2608ce8c42c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb66fee5a4dc45c58728b8c00ecd351c, user_id=d58972317fda4bea94f935d0a4785854, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:10.549094 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92bff7-b18a-40f6-9701-2608ce8c42c0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:10.638735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1380/2801] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:10 2022] PUT /identity/v3/projects/cb66fee5a4dc45c58728b8c00ecd351c/users/d58972317fda4bea94f935d0a4785854/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:10.648759 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69aea8-cfd1-49f6-9c94-7dcd32a2bd35 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:10.649057 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69aea8-cfd1-49f6-9c94-7dcd32a2bd35 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:10.649339 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69aea8-cfd1-49f6-9c94-7dcd32a2bd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:10.677662 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-db69aea8-cfd1-49f6-9c94-7dcd32a2bd35 None None] MFA Rules not processed for user `d58972317fda4bea94f935d0a4785854`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:10.679131 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-db69aea8-cfd1-49f6-9c94-7dcd32a2bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:10.743065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1422/2802] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:10.747648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92bff7-b18a-40f6-9701-2608ce8c42c0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:10.761804 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:10.813633 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92bff7-b18a-40f6-9701-2608ce8c42c0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:10.818226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d0c99-2223-4b9f-91cc-a64b048727ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:10.818907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d0c99-2223-4b9f-91cc-a64b048727ab admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:10.819193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d0c99-2223-4b9f-91cc-a64b048727ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:10.819470 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d0c99-2223-4b9f-91cc-a64b048727ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:10.820168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d0c99-2223-4b9f-91cc-a64b048727ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:10.822107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d0c99-2223-4b9f-91cc-a64b048727ab admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:10.937439 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1381/2803] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:10 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:10.941527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69aea8-cfd1-49f6-9c94-7dcd32a2bd35 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:10.947232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:10.953016 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69aea8-cfd1-49f6-9c94-7dcd32a2bd35 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:10.986039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d0c99-2223-4b9f-91cc-a64b048727ab admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:10.987884 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-509d0c99-2223-4b9f-91cc-a64b048727ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:11.014650 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc841236-07bb-4eb0-9564-1860a1c79949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:11.015237 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc841236-07bb-4eb0-9564-1860a1c79949 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:11.015550 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc841236-07bb-4eb0-9564-1860a1c79949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:11.015950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc841236-07bb-4eb0-9564-1860a1c79949 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:11.016710 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc841236-07bb-4eb0-9564-1860a1c79949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:11.018616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc841236-07bb-4eb0-9564-1860a1c79949 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:11.054625 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d0c99-2223-4b9f-91cc-a64b048727ab admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:11.058366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4311169-60e2-4447-850e-ae69cf72d935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:11.058986 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4311169-60e2-4447-850e-ae69cf72d935 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:11.059269 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4311169-60e2-4447-850e-ae69cf72d935 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:11.059548 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4311169-60e2-4447-850e-ae69cf72d935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:11.061339 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a4311169-60e2-4447-850e-ae69cf72d935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:11.070710 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4311169-60e2-4447-850e-ae69cf72d935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:11.072146 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4311169-60e2-4447-850e-ae69cf72d935 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:11.080190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1382/2804] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:37:11.112059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1423/2805] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:10 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:11.116023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4311169-60e2-4447-850e-ae69cf72d935 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:11.128521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4311169-60e2-4447-850e-ae69cf72d935 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:11.133993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45f7e2-42c7-4f9b-8f17-bee6fcbf9d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:11.134746 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45f7e2-42c7-4f9b-8f17-bee6fcbf9d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:11.135035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45f7e2-42c7-4f9b-8f17-bee6fcbf9d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:11.135310 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45f7e2-42c7-4f9b-8f17-bee6fcbf9d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:11.136033 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45f7e2-42c7-4f9b-8f17-bee6fcbf9d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:11.137736 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45f7e2-42c7-4f9b-8f17-bee6fcbf9d25 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:11.148006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1383/2806] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:37:11.152536 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc841236-07bb-4eb0-9564-1860a1c79949 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:11.162529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc841236-07bb-4eb0-9564-1860a1c79949 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:11.165301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45f7e2-42c7-4f9b-8f17-bee6fcbf9d25 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:11.167999 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd479cd-8215-415a-ba8a-3f9886bbcd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:11.168912 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd479cd-8215-415a-ba8a-3f9886bbcd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:11.169199 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd479cd-8215-415a-ba8a-3f9886bbcd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:11.170111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd479cd-8215-415a-ba8a-3f9886bbcd44 admin admin] PATH_INFO: `/v3/projects/a1ad5cf0e87247f4a631af726e1de87c/users/1c0911f4cfed4d5cb5b7d74c6df49d16/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:11.176441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45f7e2-42c7-4f9b-8f17-bee6fcbf9d25 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:11.180969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e177ab-94fa-49ac-87c4-fccdea879207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:11.181605 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e177ab-94fa-49ac-87c4-fccdea879207 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:11.181885 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e177ab-94fa-49ac-87c4-fccdea879207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:11.182155 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e177ab-94fa-49ac-87c4-fccdea879207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:11.183936 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-49e177ab-94fa-49ac-87c4-fccdea879207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:11.191626 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd479cd-8215-415a-ba8a-3f9886bbcd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ad5cf0e87247f4a631af726e1de87c, user_id=1c0911f4cfed4d5cb5b7d74c6df49d16, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:11.194401 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd479cd-8215-415a-ba8a-3f9886bbcd44 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:11.266261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e177ab-94fa-49ac-87c4-fccdea879207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:11.267624 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e177ab-94fa-49ac-87c4-fccdea879207 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:11.279791 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:11.288174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1384/2807] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:37:11.294225 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1424/2808] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:11 2022] PUT /identity/v3/projects/a1ad5cf0e87247f4a631af726e1de87c/users/1c0911f4cfed4d5cb5b7d74c6df49d16/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:11.297921 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e177ab-94fa-49ac-87c4-fccdea879207 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:11.308409 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e177ab-94fa-49ac-87c4-fccdea879207 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:11.365139 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e44a2-9ad6-4aea-bcd0-6128a9ad1d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:11.369453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e44a2-9ad6-4aea-bcd0-6128a9ad1d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:11.369453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e44a2-9ad6-4aea-bcd0-6128a9ad1d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:11.369453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e44a2-9ad6-4aea-bcd0-6128a9ad1d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:11.369453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e44a2-9ad6-4aea-bcd0-6128a9ad1d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:11.369453 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e44a2-9ad6-4aea-bcd0-6128a9ad1d42 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:11.378347 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1385/2809] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:11.382469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd479cd-8215-415a-ba8a-3f9886bbcd44 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:11.394005 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd479cd-8215-415a-ba8a-3f9886bbcd44 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:11.398952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fb9d1-6399-495f-bbd5-8ea6587899a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:11.399521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fb9d1-6399-495f-bbd5-8ea6587899a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:11.399818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fb9d1-6399-495f-bbd5-8ea6587899a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:11.400687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fb9d1-6399-495f-bbd5-8ea6587899a3 admin admin] PATH_INFO: `/v3/projects/a1ad5cf0e87247f4a631af726e1de87c/users/1c0911f4cfed4d5cb5b7d74c6df49d16/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:11.402668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fb9d1-6399-495f-bbd5-8ea6587899a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ad5cf0e87247f4a631af726e1de87c, user_id=1c0911f4cfed4d5cb5b7d74c6df49d16, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:11.405376 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fb9d1-6399-495f-bbd5-8ea6587899a3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:11.415989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1425/2810] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:11 2022] PUT /identity/v3/projects/a1ad5cf0e87247f4a631af726e1de87c/users/1c0911f4cfed4d5cb5b7d74c6df49d16/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:11.425964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5f62-c57a-4feb-9f1c-73ee5f516b74 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:11.426365 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5f62-c57a-4feb-9f1c-73ee5f516b74 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:11.426740 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5f62-c57a-4feb-9f1c-73ee5f516b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:11.455566 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-90fb5f62-c57a-4feb-9f1c-73ee5f516b74 None None] MFA Rules not processed for user `1c0911f4cfed4d5cb5b7d74c6df49d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:11.456813 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-90fb5f62-c57a-4feb-9f1c-73ee5f516b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:11.523868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1386/2811] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:11.535932 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fb9d1-6399-495f-bbd5-8ea6587899a3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:11.537735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-468fb9d1-6399-495f-bbd5-8ea6587899a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:11.618470 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fb9d1-6399-495f-bbd5-8ea6587899a3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:11.622245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86eb4b-737d-4d17-b971-dfbfb8997c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:11.622890 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86eb4b-737d-4d17-b971-dfbfb8997c1d service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:11.623174 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86eb4b-737d-4d17-b971-dfbfb8997c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:11.623452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86eb4b-737d-4d17-b971-dfbfb8997c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:11.632367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86eb4b-737d-4d17-b971-dfbfb8997c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:11.633801 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86eb4b-737d-4d17-b971-dfbfb8997c1d service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:11.643584 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1426/2812] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:12.561228 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5f62-c57a-4feb-9f1c-73ee5f516b74 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:12.624299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5f62-c57a-4feb-9f1c-73ee5f516b74 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:12.628850 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:12.629721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:12.629996 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:12.630261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] PATH_INFO: `/v3/users/d58972317fda4bea94f935d0a4785854` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:12.631428 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58972317fda4bea94f935d0a4785854)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:12.633395 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:12.654732 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:12.864404 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58972317fda4bea94f935d0a4785854'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:12.871026 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58972317fda4bea94f935d0a4785854'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:12.871694 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58972317fda4bea94f935d0a4785854'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:12.883281 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58972317fda4bea94f935d0a4785854'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:12.963814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58972317fda4bea94f935d0a4785854'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:12.969953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1387/2813] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:12 2022] DELETE /identity/v3/users/d58972317fda4bea94f935d0a4785854 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:12.974477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d79ad-d90a-40bb-852b-7abda40192d2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:12.974957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d79ad-d90a-40bb-852b-7abda40192d2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:12.975073 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d79ad-d90a-40bb-852b-7abda40192d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:12.992845 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-376d79ad-d90a-40bb-852b-7abda40192d2 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:12.994053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-376d79ad-d90a-40bb-852b-7abda40192d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:13.029173 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:13.055254 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1427/2814] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:13.064928 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:13.066304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:13.123818 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5004e-8cae-4485-bfd3-832e867e9be6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:13.127271 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1f3be-ef26-4449-a26d-5830fc830d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:13.127907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1f3be-ef26-4449-a26d-5830fc830d7d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:13.128187 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1f3be-ef26-4449-a26d-5830fc830d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:13.128494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1f3be-ef26-4449-a26d-5830fc830d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:13.138428 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1f3be-ef26-4449-a26d-5830fc830d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:13.140478 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1f3be-ef26-4449-a26d-5830fc830d7d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:13.149336 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1388/2815] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:13.575256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d79ad-d90a-40bb-852b-7abda40192d2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:13.576735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-376d79ad-d90a-40bb-852b-7abda40192d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:13.589810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d79ad-d90a-40bb-852b-7abda40192d2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:13.594469 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:13.595341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:13.595687 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:13.595957 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] PATH_INFO: `/v3/projects/cb66fee5a4dc45c58728b8c00ecd351c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:13.597269 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb66fee5a4dc45c58728b8c00ecd351c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:13.599182 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:13.700220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb66fee5a4dc45c58728b8c00ecd351c', 'request_id': 'req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:13.761614 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb66fee5a4dc45c58728b8c00ecd351c', 'request_id': 'req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:13.768090 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb66fee5a4dc45c58728b8c00ecd351c', 'request_id': 'req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:13.780226 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] The token cache is being invalidate because project cb66fee5a4dc45c58728b8c00ecd351c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:13.780543 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:13.781186 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:13.783227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1428/2816] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:13 2022] DELETE /identity/v3/projects/cb66fee5a4dc45c58728b8c00ecd351c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:13.789707 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1f3be-ef26-4449-a26d-5830fc830d7d service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:13.799975 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1f3be-ef26-4449-a26d-5830fc830d7d service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:13.858562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:13.859440 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:13.859721 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:13.859997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] PATH_INFO: `/v3/users/1c0911f4cfed4d5cb5b7d74c6df49d16` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:13.861216 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0911f4cfed4d5cb5b7d74c6df49d16)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:13.863159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:14.057215 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:14.062382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0911f4cfed4d5cb5b7d74c6df49d16'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.069319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0911f4cfed4d5cb5b7d74c6df49d16'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.070052 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0911f4cfed4d5cb5b7d74c6df49d16'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.082685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0911f4cfed4d5cb5b7d74c6df49d16'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.168061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c3d2a05b-1207-4b43-8024-39f30fa146a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0911f4cfed4d5cb5b7d74c6df49d16'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.174433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1389/2817] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:13 2022] DELETE /identity/v3/users/1c0911f4cfed4d5cb5b7d74c6df49d16 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:14.586839 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:14.588387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:14.604194 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c51c1-f5d0-435d-9903-f0b1901b8cdb admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:14.661063 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:14.661918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:14.662195 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:14.662465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] PATH_INFO: `/v3/projects/a1ad5cf0e87247f4a631af726e1de87c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:14.663622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ad5cf0e87247f4a631af726e1de87c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:14.666070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:14.768831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ad5cf0e87247f4a631af726e1de87c', 'request_id': 'req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.849049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ad5cf0e87247f4a631af726e1de87c', 'request_id': 'req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.854927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:14.860878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ad5cf0e87247f4a631af726e1de87c', 'request_id': 'req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.867669 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] The token cache is being invalidate because project a1ad5cf0e87247f4a631af726e1de87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:14.868111 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.868875 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ac25a3e0-b98d-4451-a618-82bcb2b77dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:14.870352 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1429/2818] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:14 2022] DELETE /identity/v3/projects/a1ad5cf0e87247f4a631af726e1de87c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:14.875275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372023-d1a6-4eb2-8fa1-2764e2583894 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:14.875768 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372023-d1a6-4eb2-8fa1-2764e2583894 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:14.876135 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372023-d1a6-4eb2-8fa1-2764e2583894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:14.895753 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-16372023-d1a6-4eb2-8fa1-2764e2583894 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:14.897064 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16372023-d1a6-4eb2-8fa1-2764e2583894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:14.955869 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1390/2819] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:14.965499 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67502e-e944-4770-be3d-5a4abf0348f9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:14.965787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67502e-e944-4770-be3d-5a4abf0348f9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:14.966066 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67502e-e944-4770-be3d-5a4abf0348f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:14.984578 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3e67502e-e944-4770-be3d-5a4abf0348f9 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:14.985779 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3e67502e-e944-4770-be3d-5a4abf0348f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:14.993666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1430/2820] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:14.997796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16372023-d1a6-4eb2-8fa1-2764e2583894 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.007454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16372023-d1a6-4eb2-8fa1-2764e2583894 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.012037 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd14aa-8da5-4d67-ba52-d26bcf05210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.012723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd14aa-8da5-4d67-ba52-d26bcf05210c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.013019 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd14aa-8da5-4d67-ba52-d26bcf05210c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.013291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd14aa-8da5-4d67-ba52-d26bcf05210c admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.014012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd14aa-8da5-4d67-ba52-d26bcf05210c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:37:15.014319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd14aa-8da5-4d67-ba52-d26bcf05210c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.015917 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd14aa-8da5-4d67-ba52-d26bcf05210c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:15.027854 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1391/2821] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:37:15.032039 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67502e-e944-4770-be3d-5a4abf0348f9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.041861 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67502e-e944-4770-be3d-5a4abf0348f9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.046516 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601f094-36e1-4b59-9fff-47b8d068ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.047167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601f094-36e1-4b59-9fff-47b8d068ab3a admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.047463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601f094-36e1-4b59-9fff-47b8d068ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.047745 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601f094-36e1-4b59-9fff-47b8d068ab3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.048474 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601f094-36e1-4b59-9fff-47b8d068ab3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.050365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601f094-36e1-4b59-9fff-47b8d068ab3a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:15.123936 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1431/2822] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:15 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:37:15.130040 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd14aa-8da5-4d67-ba52-d26bcf05210c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.138180 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd14aa-8da5-4d67-ba52-d26bcf05210c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.193041 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fed6a-57ae-40b0-85c6-9de2c9682955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.193700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fed6a-57ae-40b0-85c6-9de2c9682955 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.193982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fed6a-57ae-40b0-85c6-9de2c9682955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.194258 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fed6a-57ae-40b0-85c6-9de2c9682955 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.194944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fed6a-57ae-40b0-85c6-9de2c9682955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.197421 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fed6a-57ae-40b0-85c6-9de2c9682955 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:15.277284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1392/2823] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:15 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:37:15.281322 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601f094-36e1-4b59-9fff-47b8d068ab3a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.291730 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601f094-36e1-4b59-9fff-47b8d068ab3a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.296458 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9435a-1e1d-4dd6-b0fc-884cf0fd3f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.297113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9435a-1e1d-4dd6-b0fc-884cf0fd3f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.297402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9435a-1e1d-4dd6-b0fc-884cf0fd3f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.297677 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9435a-1e1d-4dd6-b0fc-884cf0fd3f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.298438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9435a-1e1d-4dd6-b0fc-884cf0fd3f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.300021 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9435a-1e1d-4dd6-b0fc-884cf0fd3f7d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:15.310795 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1432/2824] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:15.315583 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fed6a-57ae-40b0-85c6-9de2c9682955 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.326087 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fed6a-57ae-40b0-85c6-9de2c9682955 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.330959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97591d6-6609-4834-8605-ad80be37682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.331685 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97591d6-6609-4834-8605-ad80be37682a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.331979 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97591d6-6609-4834-8605-ad80be37682a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.332257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97591d6-6609-4834-8605-ad80be37682a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.333008 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97591d6-6609-4834-8605-ad80be37682a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.334609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97591d6-6609-4834-8605-ad80be37682a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:15.345220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1393/2825] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:15.349307 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9435a-1e1d-4dd6-b0fc-884cf0fd3f7d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.359246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9435a-1e1d-4dd6-b0fc-884cf0fd3f7d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.363848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a8f6e-b6ff-46a3-9138-a0bd358c6d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.364692 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a8f6e-b6ff-46a3-9138-a0bd358c6d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.364975 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a8f6e-b6ff-46a3-9138-a0bd358c6d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.365249 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a8f6e-b6ff-46a3-9138-a0bd358c6d9b admin admin] PATH_INFO: `/v3/projects/e9db9b250c324a80ac74e16f0dfe0bc9/users/28b5de2348e14ab998a8b678063c0a2f/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.380518 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a8f6e-b6ff-46a3-9138-a0bd358c6d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9db9b250c324a80ac74e16f0dfe0bc9, user_id=28b5de2348e14ab998a8b678063c0a2f, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.383178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a8f6e-b6ff-46a3-9138-a0bd358c6d9b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:15.470294 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1433/2826] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:15 2022] PUT /identity/v3/projects/e9db9b250c324a80ac74e16f0dfe0bc9/users/28b5de2348e14ab998a8b678063c0a2f/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:37:15.480475 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002452f-454e-476f-8466-2a4194e3cad2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.480770 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002452f-454e-476f-8466-2a4194e3cad2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.481049 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002452f-454e-476f-8466-2a4194e3cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.507325 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0002452f-454e-476f-8466-2a4194e3cad2 None None] MFA Rules not processed for user `28b5de2348e14ab998a8b678063c0a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:15.508547 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0002452f-454e-476f-8466-2a4194e3cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:15.520825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:15.571462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1394/2827] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:15.576572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a8f6e-b6ff-46a3-9138-a0bd358c6d9b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.638045 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a8f6e-b6ff-46a3-9138-a0bd358c6d9b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.642794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399199-3a72-441d-ac69-ca7927b8d50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.643479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399199-3a72-441d-ac69-ca7927b8d50a admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.643763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399199-3a72-441d-ac69-ca7927b8d50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.644037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399199-3a72-441d-ac69-ca7927b8d50a admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.644746 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16399199-3a72-441d-ac69-ca7927b8d50a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.646735 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16399199-3a72-441d-ac69-ca7927b8d50a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:15.739387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1434/2828] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:15 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:15.743437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002452f-454e-476f-8466-2a4194e3cad2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.754673 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002452f-454e-476f-8466-2a4194e3cad2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.809944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f03db9-72e4-4260-91f6-8e700caa5b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.810618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f03db9-72e4-4260-91f6-8e700caa5b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.810904 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f03db9-72e4-4260-91f6-8e700caa5b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.811209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f03db9-72e4-4260-91f6-8e700caa5b1a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.811910 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f03db9-72e4-4260-91f6-8e700caa5b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.813931 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f03db9-72e4-4260-91f6-8e700caa5b1a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:15.896617 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1395/2829] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:15 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:15.897782 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399199-3a72-441d-ac69-ca7927b8d50a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.907965 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399199-3a72-441d-ac69-ca7927b8d50a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.913135 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a944697-c681-46ae-aefe-2c52fa2ab1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.913644 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a944697-c681-46ae-aefe-2c52fa2ab1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.913927 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a944697-c681-46ae-aefe-2c52fa2ab1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.914203 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a944697-c681-46ae-aefe-2c52fa2ab1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.914920 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a944697-c681-46ae-aefe-2c52fa2ab1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.917196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a944697-c681-46ae-aefe-2c52fa2ab1f3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:15.928256 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1435/2830] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:15.932802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f03db9-72e4-4260-91f6-8e700caa5b1a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:15.942795 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f03db9-72e4-4260-91f6-8e700caa5b1a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:15.947433 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c939-4148-4239-b415-5233025c7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:15.948337 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c939-4148-4239-b415-5233025c7372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:15.948622 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c939-4148-4239-b415-5233025c7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:15.948897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660c939-4148-4239-b415-5233025c7372 admin admin] PATH_INFO: `/v3/projects/50998f2d0a3c45c89c99f64fdf2dc03f/users/79f0e75de0714592bee1db30a050f84c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:15.964340 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660c939-4148-4239-b415-5233025c7372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50998f2d0a3c45c89c99f64fdf2dc03f, user_id=79f0e75de0714592bee1db30a050f84c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:15.967038 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660c939-4148-4239-b415-5233025c7372 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:16.054890 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1396/2831] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:15 2022] PUT /identity/v3/projects/50998f2d0a3c45c89c99f64fdf2dc03f/users/79f0e75de0714592bee1db30a050f84c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:16.063665 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a944697-c681-46ae-aefe-2c52fa2ab1f3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:16.073918 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a944697-c681-46ae-aefe-2c52fa2ab1f3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:16.131622 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaa723-6bdd-4ea3-bdc6-0f16a60574e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:16.132405 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaa723-6bdd-4ea3-bdc6-0f16a60574e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:16.132783 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaa723-6bdd-4ea3-bdc6-0f16a60574e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:16.133065 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaa723-6bdd-4ea3-bdc6-0f16a60574e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:16.133807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaa723-6bdd-4ea3-bdc6-0f16a60574e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:16.135430 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aaa723-6bdd-4ea3-bdc6-0f16a60574e3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:16.137468 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:16.146008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1436/2832] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:16.150129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c939-4148-4239-b415-5233025c7372 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:16.160521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660c939-4148-4239-b415-5233025c7372 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:16.165129 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5676c0-204a-4fbe-b17f-1db1d9bb8618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:16.166508 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5676c0-204a-4fbe-b17f-1db1d9bb8618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:16.166793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5676c0-204a-4fbe-b17f-1db1d9bb8618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:16.167068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5676c0-204a-4fbe-b17f-1db1d9bb8618 admin admin] PATH_INFO: `/v3/projects/50998f2d0a3c45c89c99f64fdf2dc03f/users/79f0e75de0714592bee1db30a050f84c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:16.169042 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5676c0-204a-4fbe-b17f-1db1d9bb8618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50998f2d0a3c45c89c99f64fdf2dc03f, user_id=79f0e75de0714592bee1db30a050f84c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:16.171688 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5676c0-204a-4fbe-b17f-1db1d9bb8618 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:16.183802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1397/2833] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:16 2022] PUT /identity/v3/projects/50998f2d0a3c45c89c99f64fdf2dc03f/users/79f0e75de0714592bee1db30a050f84c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:16.195014 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884ba88-0b6a-481d-8d77-3696c01a4f76 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:16.195386 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884ba88-0b6a-481d-8d77-3696c01a4f76 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:16.195731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884ba88-0b6a-481d-8d77-3696c01a4f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:16.225027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a884ba88-0b6a-481d-8d77-3696c01a4f76 None None] MFA Rules not processed for user `79f0e75de0714592bee1db30a050f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:16.226264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a884ba88-0b6a-481d-8d77-3696c01a4f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:16.306095 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1437/2834] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:16.316542 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5676c0-204a-4fbe-b17f-1db1d9bb8618 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:16.318314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5b5676c0-204a-4fbe-b17f-1db1d9bb8618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:16.379288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5676c0-204a-4fbe-b17f-1db1d9bb8618 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:16.383057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c06a0-3b15-444f-8c9d-4abf8e4da32c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:16.383709 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c06a0-3b15-444f-8c9d-4abf8e4da32c service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:16.383988 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c06a0-3b15-444f-8c9d-4abf8e4da32c service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:16.384366 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c06a0-3b15-444f-8c9d-4abf8e4da32c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:16.394682 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c06a0-3b15-444f-8c9d-4abf8e4da32c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:16.396275 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c06a0-3b15-444f-8c9d-4abf8e4da32c service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:16.407382 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1398/2835] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:16 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:37:19.186271 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884ba88-0b6a-481d-8d77-3696c01a4f76 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:19.247446 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884ba88-0b6a-481d-8d77-3696c01a4f76 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:19.251904 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:19.252790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:19.253072 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:19.253348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] PATH_INFO: `/v3/users/28b5de2348e14ab998a8b678063c0a2f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:19.254495 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b5de2348e14ab998a8b678063c0a2f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:19.256472 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:19.465615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b5de2348e14ab998a8b678063c0a2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:19.466777 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b5de2348e14ab998a8b678063c0a2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:19.473549 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b5de2348e14ab998a8b678063c0a2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:19.474169 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b5de2348e14ab998a8b678063c0a2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:19.485729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b5de2348e14ab998a8b678063c0a2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:19.576641 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1438/2836] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:19 2022] DELETE /identity/v3/users/28b5de2348e14ab998a8b678063c0a2f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:19.581208 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e80c7-84fb-4e51-a832-1d15b416ccd6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:19.581722 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e80c7-84fb-4e51-a832-1d15b416ccd6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:19.581825 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e80c7-84fb-4e51-a832-1d15b416ccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:19.599650 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7e8e80c7-84fb-4e51-a832-1d15b416ccd6 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:19.600888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7e8e80c7-84fb-4e51-a832-1d15b416ccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:19.605351 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:19.659370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1399/2837] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:19.669615 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:19.671123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:19.676449 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:19.727416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06615e4-df50-47d0-8a1f-32b4eab31506 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:19.731505 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ff379-7494-4f3a-a710-1bdce9d7e27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:19.732179 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ff379-7494-4f3a-a710-1bdce9d7e27c service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:19.732503 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ff379-7494-4f3a-a710-1bdce9d7e27c service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:19.732790 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ff379-7494-4f3a-a710-1bdce9d7e27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:19.742196 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ff379-7494-4f3a-a710-1bdce9d7e27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:19.745969 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ff379-7494-4f3a-a710-1bdce9d7e27c service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:19.753651 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1439/2838] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:20.152667 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e80c7-84fb-4e51-a832-1d15b416ccd6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:20.157606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7e8e80c7-84fb-4e51-a832-1d15b416ccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:20.166797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e80c7-84fb-4e51-a832-1d15b416ccd6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:20.171418 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:20.172304 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:20.172618 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:20.172895 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] PATH_INFO: `/v3/projects/e9db9b250c324a80ac74e16f0dfe0bc9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:20.174154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9db9b250c324a80ac74e16f0dfe0bc9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:20.175982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:20.270951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9db9b250c324a80ac74e16f0dfe0bc9', 'request_id': 'req-4252b1df-3a87-4264-9d2b-1427caf2a8b7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.328464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9db9b250c324a80ac74e16f0dfe0bc9', 'request_id': 'req-4252b1df-3a87-4264-9d2b-1427caf2a8b7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.335231 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9db9b250c324a80ac74e16f0dfe0bc9', 'request_id': 'req-4252b1df-3a87-4264-9d2b-1427caf2a8b7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.346511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] The token cache is being invalidate because project e9db9b250c324a80ac74e16f0dfe0bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:20.346805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.347464 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.349034 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1400/2839] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:20 2022] DELETE /identity/v3/projects/e9db9b250c324a80ac74e16f0dfe0bc9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:20.353731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ff379-7494-4f3a-a710-1bdce9d7e27c service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:20.363634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ff379-7494-4f3a-a710-1bdce9d7e27c service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:20.424103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:20.427218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:20.427218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:20.427218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] PATH_INFO: `/v3/users/79f0e75de0714592bee1db30a050f84c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:20.427218 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f0e75de0714592bee1db30a050f84c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:20.429360 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:20.638400 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f0e75de0714592bee1db30a050f84c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.639059 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f0e75de0714592bee1db30a050f84c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.645831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f0e75de0714592bee1db30a050f84c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.646452 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f0e75de0714592bee1db30a050f84c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.658907 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8c588d70-dedd-44b9-999c-b1d65ba9efbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f0e75de0714592bee1db30a050f84c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:20.720437 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1440/2840] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:20 2022] DELETE /identity/v3/users/79f0e75de0714592bee1db30a050f84c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:21.129287 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:21.134161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:21.143589 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b1df-3a87-4264-9d2b-1427caf2a8b7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:21.205437 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:21.206295 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:21.206580 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:21.206853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] PATH_INFO: `/v3/projects/50998f2d0a3c45c89c99f64fdf2dc03f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:21.208016 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50998f2d0a3c45c89c99f64fdf2dc03f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:21.209985 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:21.345971 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:21.355784 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50998f2d0a3c45c89c99f64fdf2dc03f', 'request_id': 'req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:21.413911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50998f2d0a3c45c89c99f64fdf2dc03f', 'request_id': 'req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:21.421131 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50998f2d0a3c45c89c99f64fdf2dc03f', 'request_id': 'req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:21.432160 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] The token cache is being invalidate because project 50998f2d0a3c45c89c99f64fdf2dc03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:21.432480 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:21.433107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fa98b9b0-0087-46b7-aa27-d69ca6b25f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:21.434646 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1401/2841] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:21 2022] DELETE /identity/v3/projects/50998f2d0a3c45c89c99f64fdf2dc03f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:21.439465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d1f9f-e1f0-4959-adfe-82c699b1c1a4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:21.439938 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d1f9f-e1f0-4959-adfe-82c699b1c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:21.440049 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d1f9f-e1f0-4959-adfe-82c699b1c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:21.457734 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-189d1f9f-e1f0-4959-adfe-82c699b1c1a4 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:21.458928 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-189d1f9f-e1f0-4959-adfe-82c699b1c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:21.477983 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:21.518631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1441/2842] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:21.527065 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae11c4-6106-42ba-95f6-7ed679a3890c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:21.527357 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae11c4-6106-42ba-95f6-7ed679a3890c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:21.527635 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae11c4-6106-42ba-95f6-7ed679a3890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:21.545829 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b0ae11c4-6106-42ba-95f6-7ed679a3890c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:21.547011 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b0ae11c4-6106-42ba-95f6-7ed679a3890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:21.555110 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1402/2843] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:21.559110 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d1f9f-e1f0-4959-adfe-82c699b1c1a4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:21.568621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d1f9f-e1f0-4959-adfe-82c699b1c1a4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:21.573189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac9567-8db3-425c-9c93-2d1f709b1fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:21.573840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9567-8db3-425c-9c93-2d1f709b1fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:21.574125 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9567-8db3-425c-9c93-2d1f709b1fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:21.584243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9567-8db3-425c-9c93-2d1f709b1fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:21.584243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac9567-8db3-425c-9c93-2d1f709b1fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:37:21.584243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac9567-8db3-425c-9c93-2d1f709b1fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:21.584243 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac9567-8db3-425c-9c93-2d1f709b1fa5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:21.589002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1442/2844] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:37:21.593222 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae11c4-6106-42ba-95f6-7ed679a3890c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:21.602448 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae11c4-6106-42ba-95f6-7ed679a3890c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:21.607729 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5d2e9-cf93-4b0b-81a4-e07a535a3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:21.608407 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5d2e9-cf93-4b0b-81a4-e07a535a3798 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:21.612939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5d2e9-cf93-4b0b-81a4-e07a535a3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:21.612939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5d2e9-cf93-4b0b-81a4-e07a535a3798 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:21.612939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5d2e9-cf93-4b0b-81a4-e07a535a3798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:21.612939 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5d2e9-cf93-4b0b-81a4-e07a535a3798 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:21.694655 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1403/2845] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:21 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:21.708828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac9567-8db3-425c-9c93-2d1f709b1fa5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:21.719187 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac9567-8db3-425c-9c93-2d1f709b1fa5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:21.773744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956528ea-b86d-41d5-b32d-a45987fed04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:21.774416 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956528ea-b86d-41d5-b32d-a45987fed04f admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:21.775214 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956528ea-b86d-41d5-b32d-a45987fed04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:21.775492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956528ea-b86d-41d5-b32d-a45987fed04f admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:21.776230 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956528ea-b86d-41d5-b32d-a45987fed04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:21.778193 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956528ea-b86d-41d5-b32d-a45987fed04f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:21.875365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1443/2846] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:21 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:21.879344 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5d2e9-cf93-4b0b-81a4-e07a535a3798 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:21.890349 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5d2e9-cf93-4b0b-81a4-e07a535a3798 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:21.894914 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caba75e-7dc4-4829-a473-d46f9f036af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:21.895579 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caba75e-7dc4-4829-a473-d46f9f036af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:21.895866 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caba75e-7dc4-4829-a473-d46f9f036af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:21.896144 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caba75e-7dc4-4829-a473-d46f9f036af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:21.896937 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caba75e-7dc4-4829-a473-d46f9f036af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:21.898543 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caba75e-7dc4-4829-a473-d46f9f036af6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:21.909045 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1404/2847] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:21.913119 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956528ea-b86d-41d5-b32d-a45987fed04f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:21.923221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956528ea-b86d-41d5-b32d-a45987fed04f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:21.933347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7cd74-4fb5-4ee2-aabe-f4c5a242e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:21.933347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7cd74-4fb5-4ee2-aabe-f4c5a242e70f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:21.933347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7cd74-4fb5-4ee2-aabe-f4c5a242e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:21.933347 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7cd74-4fb5-4ee2-aabe-f4c5a242e70f admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:21.933831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7cd74-4fb5-4ee2-aabe-f4c5a242e70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:21.933831 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7cd74-4fb5-4ee2-aabe-f4c5a242e70f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:21.941344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1444/2848] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:21.945177 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caba75e-7dc4-4829-a473-d46f9f036af6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:21.955456 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caba75e-7dc4-4829-a473-d46f9f036af6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:21.960036 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9169e6-cd5a-43d5-91c3-ce04a988ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:21.960964 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9169e6-cd5a-43d5-91c3-ce04a988ae44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:21.962105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9169e6-cd5a-43d5-91c3-ce04a988ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:21.962105 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9169e6-cd5a-43d5-91c3-ce04a988ae44 admin admin] PATH_INFO: `/v3/projects/f3e2e96067d14dceb47b9cc928dccecd/users/a7d4d365d460406a8c9ae5d909461fa3/roles/64789f5937034a188d1774823d2387cb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:21.976657 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9169e6-cd5a-43d5-91c3-ce04a988ae44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e2e96067d14dceb47b9cc928dccecd, user_id=a7d4d365d460406a8c9ae5d909461fa3, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:21.979370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9169e6-cd5a-43d5-91c3-ce04a988ae44 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:22.077515 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1405/2849] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:21 2022] PUT /identity/v3/projects/f3e2e96067d14dceb47b9cc928dccecd/users/a7d4d365d460406a8c9ae5d909461fa3/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:37:22.088246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e00a-e33a-461d-a1e8-8e72c33a4ecd None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:22.088562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e00a-e33a-461d-a1e8-8e72c33a4ecd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:22.088841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e00a-e33a-461d-a1e8-8e72c33a4ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:22.115438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-46e6e00a-e33a-461d-a1e8-8e72c33a4ecd None None] MFA Rules not processed for user `a7d4d365d460406a8c9ae5d909461fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:22.116685 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-46e6e00a-e33a-461d-a1e8-8e72c33a4ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:22.179519 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1445/2850] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:22.184149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9169e6-cd5a-43d5-91c3-ce04a988ae44 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:22.244868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9169e6-cd5a-43d5-91c3-ce04a988ae44 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:22.249482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bf414-aa82-4192-9f38-c56536b03a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:22.250134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bf414-aa82-4192-9f38-c56536b03a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:22.250422 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bf414-aa82-4192-9f38-c56536b03a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:22.250702 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bf414-aa82-4192-9f38-c56536b03a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:22.251425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bf414-aa82-4192-9f38-c56536b03a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:22.253405 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bf414-aa82-4192-9f38-c56536b03a30 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:22.363497 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1406/2851] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:22 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:22.367740 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6e00a-e33a-461d-a1e8-8e72c33a4ecd None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:22.378811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6e00a-e33a-461d-a1e8-8e72c33a4ecd None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:22.395571 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:22.434372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955d0a-e738-4148-b329-f4c5dd286424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:22.434973 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955d0a-e738-4148-b329-f4c5dd286424 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:22.435255 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955d0a-e738-4148-b329-f4c5dd286424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:22.435558 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8955d0a-e738-4148-b329-f4c5dd286424 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:22.436236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8955d0a-e738-4148-b329-f4c5dd286424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:22.438184 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8955d0a-e738-4148-b329-f4c5dd286424 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:22.521602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1446/2852] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:22 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:22.525463 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bf414-aa82-4192-9f38-c56536b03a30 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:22.535636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bf414-aa82-4192-9f38-c56536b03a30 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:22.540255 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6bd55-baf2-4f7c-8722-161be0c537f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:22.540952 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6bd55-baf2-4f7c-8722-161be0c537f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:22.541234 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6bd55-baf2-4f7c-8722-161be0c537f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:22.541512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6bd55-baf2-4f7c-8722-161be0c537f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:22.542259 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6bd55-baf2-4f7c-8722-161be0c537f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:22.543855 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6bd55-baf2-4f7c-8722-161be0c537f9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:22.554911 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1407/2853] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:22.559409 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955d0a-e738-4148-b329-f4c5dd286424 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:22.569500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8955d0a-e738-4148-b329-f4c5dd286424 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:22.574689 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e7c9a-9542-4961-aa86-c04abff71949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:22.575561 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e7c9a-9542-4961-aa86-c04abff71949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:22.575840 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e7c9a-9542-4961-aa86-c04abff71949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:22.576115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e7c9a-9542-4961-aa86-c04abff71949 admin admin] PATH_INFO: `/v3/projects/180c92ae74a54d6489c7c1219f451024/users/cd11a8e1972f4bae84b7e9fe23d15a7c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:22.590565 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e7c9a-9542-4961-aa86-c04abff71949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180c92ae74a54d6489c7c1219f451024, user_id=cd11a8e1972f4bae84b7e9fe23d15a7c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:22.593221 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e7c9a-9542-4961-aa86-c04abff71949 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:22.669798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1447/2854] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:22 2022] PUT /identity/v3/projects/180c92ae74a54d6489c7c1219f451024/users/cd11a8e1972f4bae84b7e9fe23d15a7c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:37:22.673648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6bd55-baf2-4f7c-8722-161be0c537f9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:22.684575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6bd55-baf2-4f7c-8722-161be0c537f9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:22.713704 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:22.739374 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5b74-cbb9-4deb-b1e9-f7adf20b3391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:22.740066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5b74-cbb9-4deb-b1e9-f7adf20b3391 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:22.740383 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5b74-cbb9-4deb-b1e9-f7adf20b3391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:22.740665 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5b74-cbb9-4deb-b1e9-f7adf20b3391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:22.741385 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a5b74-cbb9-4deb-b1e9-f7adf20b3391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:22.742982 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a5b74-cbb9-4deb-b1e9-f7adf20b3391 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:22.753758 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1408/2855] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:22.757717 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e7c9a-9542-4961-aa86-c04abff71949 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:22.768012 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e7c9a-9542-4961-aa86-c04abff71949 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:22.773042 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb2e2-ff51-424d-853a-b5d94cb793b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:22.773934 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb2e2-ff51-424d-853a-b5d94cb793b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:22.774216 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb2e2-ff51-424d-853a-b5d94cb793b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:22.774492 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb2e2-ff51-424d-853a-b5d94cb793b7 admin admin] PATH_INFO: `/v3/projects/180c92ae74a54d6489c7c1219f451024/users/cd11a8e1972f4bae84b7e9fe23d15a7c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:22.776555 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb2e2-ff51-424d-853a-b5d94cb793b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180c92ae74a54d6489c7c1219f451024, user_id=cd11a8e1972f4bae84b7e9fe23d15a7c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:22.779290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb2e2-ff51-424d-853a-b5d94cb793b7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:22.789707 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1448/2856] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:22 2022] PUT /identity/v3/projects/180c92ae74a54d6489c7c1219f451024/users/cd11a8e1972f4bae84b7e9fe23d15a7c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:22.801805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b858b-08de-4dee-973d-d551e0c8d5a7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:22.801805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b858b-08de-4dee-973d-d551e0c8d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:22.802082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b858b-08de-4dee-973d-d551e0c8d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:22.829660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2a4b858b-08de-4dee-973d-d551e0c8d5a7 None None] MFA Rules not processed for user `cd11a8e1972f4bae84b7e9fe23d15a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:22.830876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2a4b858b-08de-4dee-973d-d551e0c8d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:22.896686 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1409/2857] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:22.907748 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb2e2-ff51-424d-853a-b5d94cb793b7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:22.909647 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d81bb2e2-ff51-424d-853a-b5d94cb793b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:22.969224 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb2e2-ff51-424d-853a-b5d94cb793b7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:22.972955 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b81ec1-4f9f-4324-9a95-468c4fa3defd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:22.973603 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b81ec1-4f9f-4324-9a95-468c4fa3defd service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:22.973892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b81ec1-4f9f-4324-9a95-468c4fa3defd service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:22.974169 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b81ec1-4f9f-4324-9a95-468c4fa3defd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:22.984138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b81ec1-4f9f-4324-9a95-468c4fa3defd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:22.986562 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b81ec1-4f9f-4324-9a95-468c4fa3defd service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:22.997371 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1449/2858] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:23.060681 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b858b-08de-4dee-973d-d551e0c8d5a7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:23.121842 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b858b-08de-4dee-973d-d551e0c8d5a7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:23.126350 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:23.127241 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:23.127524 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:23.127797 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] PATH_INFO: `/v3/users/a7d4d365d460406a8c9ae5d909461fa3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:23.129021 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d4d365d460406a8c9ae5d909461fa3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:23.130951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:23.301253 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d4d365d460406a8c9ae5d909461fa3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:23.308257 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d4d365d460406a8c9ae5d909461fa3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:23.308989 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d4d365d460406a8c9ae5d909461fa3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:23.310101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:23.320856 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d4d365d460406a8c9ae5d909461fa3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:23.384558 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d4d365d460406a8c9ae5d909461fa3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:23.391168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1410/2859] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:23 2022] DELETE /identity/v3/users/a7d4d365d460406a8c9ae5d909461fa3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:23.395910 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055b8a8-bac7-43f6-b392-537994878750 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:23.396205 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055b8a8-bac7-43f6-b392-537994878750 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:23.396515 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055b8a8-bac7-43f6-b392-537994878750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:23.414799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0055b8a8-bac7-43f6-b392-537994878750 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:23.419865 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0055b8a8-bac7-43f6-b392-537994878750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:23.473952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1450/2860] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:23.483509 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:23.484948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:23.541015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd406e16-e3e1-4f5e-9259-32bf159941bf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:23.544636 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f456fc3-b9ce-4a69-8553-c0bb2d601eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:23.545272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f456fc3-b9ce-4a69-8553-c0bb2d601eef service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:23.545555 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f456fc3-b9ce-4a69-8553-c0bb2d601eef service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:23.545833 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f456fc3-b9ce-4a69-8553-c0bb2d601eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:23.554957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f456fc3-b9ce-4a69-8553-c0bb2d601eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:23.556343 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f456fc3-b9ce-4a69-8553-c0bb2d601eef service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:23.565909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1411/2861] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:23.986744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055b8a8-bac7-43f6-b392-537994878750 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:23.988201 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0055b8a8-bac7-43f6-b392-537994878750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:24.002447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055b8a8-bac7-43f6-b392-537994878750 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:24.007155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:24.008744 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:24.009643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:24.009963 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] PATH_INFO: `/v3/projects/f3e2e96067d14dceb47b9cc928dccecd` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:24.011115 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e2e96067d14dceb47b9cc928dccecd)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:24.013103 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:24.024127 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:24.117181 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e2e96067d14dceb47b9cc928dccecd', 'request_id': 'req-70d95176-94a7-426a-b290-3cacdf988aa6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.225194 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e2e96067d14dceb47b9cc928dccecd', 'request_id': 'req-70d95176-94a7-426a-b290-3cacdf988aa6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.231390 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e2e96067d14dceb47b9cc928dccecd', 'request_id': 'req-70d95176-94a7-426a-b290-3cacdf988aa6'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.242403 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] The token cache is being invalidate because project f3e2e96067d14dceb47b9cc928dccecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:24.242715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.244047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.245661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1451/2862] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:23 2022] DELETE /identity/v3/projects/f3e2e96067d14dceb47b9cc928dccecd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:24.249714 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f456fc3-b9ce-4a69-8553-c0bb2d601eef service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:24.259182 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f456fc3-b9ce-4a69-8553-c0bb2d601eef service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:24.315299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:24.316154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:24.316469 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:24.316750 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] PATH_INFO: `/v3/users/cd11a8e1972f4bae84b7e9fe23d15a7c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:24.317926 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd11a8e1972f4bae84b7e9fe23d15a7c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:24.319858 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:24.469779 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd11a8e1972f4bae84b7e9fe23d15a7c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.476494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd11a8e1972f4bae84b7e9fe23d15a7c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.477154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd11a8e1972f4bae84b7e9fe23d15a7c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.489162 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd11a8e1972f4bae84b7e9fe23d15a7c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.492677 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:24.539362 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e147d814-306c-4a0b-8850-c6ccfb666224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd11a8e1972f4bae84b7e9fe23d15a7c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:24.548168 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1412/2863] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:24 2022] DELETE /identity/v3/users/cd11a8e1972f4bae84b7e9fe23d15a7c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:24.958056 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:24.959552 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:24.974024 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d95176-94a7-426a-b290-3cacdf988aa6 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:25.033219 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:25.034006 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.034291 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.034566 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] PATH_INFO: `/v3/projects/180c92ae74a54d6489c7c1219f451024` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.035766 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] RBAC: Authorizing `identity:delete_project(project_id=180c92ae74a54d6489c7c1219f451024)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:25.037765 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:25.132253 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180c92ae74a54d6489c7c1219f451024', 'request_id': 'req-b5a33517-d22b-417d-ab15-f1092ce4314f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:25.196192 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180c92ae74a54d6489c7c1219f451024', 'request_id': 'req-b5a33517-d22b-417d-ab15-f1092ce4314f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:25.202970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180c92ae74a54d6489c7c1219f451024', 'request_id': 'req-b5a33517-d22b-417d-ab15-f1092ce4314f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:25.214613 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] The token cache is being invalidate because project 180c92ae74a54d6489c7c1219f451024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:25.214899 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:25.215527 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b5a33517-d22b-417d-ab15-f1092ce4314f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:25.217087 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1452/2864] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:24 2022] DELETE /identity/v3/projects/180c92ae74a54d6489c7c1219f451024 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:25.222050 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d98b-c025-4640-9cbd-93e8cfb1e456 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.225647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d98b-c025-4640-9cbd-93e8cfb1e456 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.225647 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d98b-c025-4640-9cbd-93e8cfb1e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.240301 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2604d98b-c025-4640-9cbd-93e8cfb1e456 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:25.241536 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2604d98b-c025-4640-9cbd-93e8cfb1e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:25.299043 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1413/2865] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:25.307465 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237b3d6-1489-47ab-bc48-055840ee880c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.307757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237b3d6-1489-47ab-bc48-055840ee880c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.308038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237b3d6-1489-47ab-bc48-055840ee880c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.327276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0237b3d6-1489-47ab-bc48-055840ee880c None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:25.328627 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0237b3d6-1489-47ab-bc48-055840ee880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:25.337266 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1453/2866] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:25.341519 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d98b-c025-4640-9cbd-93e8cfb1e456 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:25.351115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d98b-c025-4640-9cbd-93e8cfb1e456 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:25.355853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350bc19-0cb3-4b65-be3e-09c51b11cc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:25.356531 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350bc19-0cb3-4b65-be3e-09c51b11cc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.356814 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350bc19-0cb3-4b65-be3e-09c51b11cc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.357092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350bc19-0cb3-4b65-be3e-09c51b11cc8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.357841 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350bc19-0cb3-4b65-be3e-09c51b11cc8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:37:25.358150 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350bc19-0cb3-4b65-be3e-09c51b11cc8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:25.359767 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350bc19-0cb3-4b65-be3e-09c51b11cc8f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:25.371689 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1414/2867] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:37:25.376017 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237b3d6-1489-47ab-bc48-055840ee880c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:25.385848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237b3d6-1489-47ab-bc48-055840ee880c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:25.390851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5701-4756-4f42-9a96-14c2ae48a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:25.391511 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5701-4756-4f42-9a96-14c2ae48a57e admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.391794 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5701-4756-4f42-9a96-14c2ae48a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.392070 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5701-4756-4f42-9a96-14c2ae48a57e admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.392797 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5701-4756-4f42-9a96-14c2ae48a57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:25.394694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5701-4756-4f42-9a96-14c2ae48a57e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:25.477606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:25.484425 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1454/2868] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:25 2022] POST /identity/v3/projects => generated 407 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:25.488482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350bc19-0cb3-4b65-be3e-09c51b11cc8f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:25.498853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350bc19-0cb3-4b65-be3e-09c51b11cc8f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:25.554159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7d7a-d3e7-4f19-aa43-670bd3f2688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:25.554754 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7d7a-d3e7-4f19-aa43-670bd3f2688f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.555104 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7d7a-d3e7-4f19-aa43-670bd3f2688f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.555314 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7d7a-d3e7-4f19-aa43-670bd3f2688f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.556561 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef7d7a-d3e7-4f19-aa43-670bd3f2688f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:25.558489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef7d7a-d3e7-4f19-aa43-670bd3f2688f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:25.671119 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1415/2869] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:25 2022] POST /identity/v3/users => generated 304 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:37:25.675336 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5701-4756-4f42-9a96-14c2ae48a57e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:25.686949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5701-4756-4f42-9a96-14c2ae48a57e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:25.691598 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb5da1-9121-48c8-b315-a4d6521d6e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:25.692251 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb5da1-9121-48c8-b315-a4d6521d6e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.692616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb5da1-9121-48c8-b315-a4d6521d6e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.692892 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb5da1-9121-48c8-b315-a4d6521d6e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.693606 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb5da1-9121-48c8-b315-a4d6521d6e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:25.695175 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb5da1-9121-48c8-b315-a4d6521d6e63 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:25.706411 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1455/2870] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:25.710261 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7d7a-d3e7-4f19-aa43-670bd3f2688f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:25.720197 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7d7a-d3e7-4f19-aa43-670bd3f2688f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:25.724925 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61f653-c987-4e50-89e0-fc152bcee774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:25.725573 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61f653-c987-4e50-89e0-fc152bcee774 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.725853 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61f653-c987-4e50-89e0-fc152bcee774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.726128 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61f653-c987-4e50-89e0-fc152bcee774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.726868 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61f653-c987-4e50-89e0-fc152bcee774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:25.729066 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61f653-c987-4e50-89e0-fc152bcee774 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:25.738953 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1416/2871] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 03:37:25.742829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb5da1-9121-48c8-b315-a4d6521d6e63 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:25.753250 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb5da1-9121-48c8-b315-a4d6521d6e63 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:25.758313 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf72cb-df26-4996-998b-ded8a13f4c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:25.759176 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf72cb-df26-4996-998b-ded8a13f4c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.759459 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf72cb-df26-4996-998b-ded8a13f4c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.759729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf72cb-df26-4996-998b-ded8a13f4c14 admin admin] PATH_INFO: `/v3/projects/ec394478981d4927b2e81898b24b117d/users/53c69ab0c143416eaabb9c1c0458a82d/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.773818 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf72cb-df26-4996-998b-ded8a13f4c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec394478981d4927b2e81898b24b117d, user_id=53c69ab0c143416eaabb9c1c0458a82d, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:25.776482 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf72cb-df26-4996-998b-ded8a13f4c14 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:25.872003 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1456/2872] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:25 2022] PUT /identity/v3/projects/ec394478981d4927b2e81898b24b117d/users/53c69ab0c143416eaabb9c1c0458a82d/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:37:25.882035 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fde5e-e57b-4251-8f50-13a692549ca9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:25.882329 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fde5e-e57b-4251-8f50-13a692549ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:25.882611 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fde5e-e57b-4251-8f50-13a692549ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:25.908489 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ca2fde5e-e57b-4251-8f50-13a692549ca9 None None] MFA Rules not processed for user `53c69ab0c143416eaabb9c1c0458a82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:25.909735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ca2fde5e-e57b-4251-8f50-13a692549ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:25.956211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:25.972872 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1417/2873] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:25.977270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf72cb-df26-4996-998b-ded8a13f4c14 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:26.038262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf72cb-df26-4996-998b-ded8a13f4c14 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:26.043546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c4207-b0e4-4f93-aa35-b66e6f57953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:26.044200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c4207-b0e4-4f93-aa35-b66e6f57953d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:26.044521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c4207-b0e4-4f93-aa35-b66e6f57953d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:26.044804 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c4207-b0e4-4f93-aa35-b66e6f57953d admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:26.045494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c4207-b0e4-4f93-aa35-b66e6f57953d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:26.047402 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c4207-b0e4-4f93-aa35-b66e6f57953d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:26.133259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1457/2874] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:25 2022] POST /identity/v3/projects => generated 409 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:26.137254 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fde5e-e57b-4251-8f50-13a692549ca9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:26.148193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fde5e-e57b-4251-8f50-13a692549ca9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:26.202843 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926aaf7-731f-4609-be86-579d6f1464c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:26.203512 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926aaf7-731f-4609-be86-579d6f1464c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:26.203793 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926aaf7-731f-4609-be86-579d6f1464c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:26.204071 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926aaf7-731f-4609-be86-579d6f1464c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:26.204796 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926aaf7-731f-4609-be86-579d6f1464c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:26.206717 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926aaf7-731f-4609-be86-579d6f1464c2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:26.294136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1418/2875] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:26 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:26.297989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c4207-b0e4-4f93-aa35-b66e6f57953d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:26.308625 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c4207-b0e4-4f93-aa35-b66e6f57953d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:26.313301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff888-7a21-406e-8e7f-f385fe23aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:26.313951 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff888-7a21-406e-8e7f-f385fe23aec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:26.314270 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff888-7a21-406e-8e7f-f385fe23aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:26.314591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff888-7a21-406e-8e7f-f385fe23aec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:26.315301 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ff888-7a21-406e-8e7f-f385fe23aec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:26.316924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ff888-7a21-406e-8e7f-f385fe23aec3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:26.327949 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1458/2876] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:26.332001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926aaf7-731f-4609-be86-579d6f1464c2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:26.342393 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926aaf7-731f-4609-be86-579d6f1464c2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:26.347058 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74801f92-7865-4b96-8571-15bb90b9df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:26.347948 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74801f92-7865-4b96-8571-15bb90b9df69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:26.348228 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74801f92-7865-4b96-8571-15bb90b9df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:26.348532 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74801f92-7865-4b96-8571-15bb90b9df69 admin admin] PATH_INFO: `/v3/projects/60bf0d01731f4923bc6dd8aa5741aa0d/users/71f9657236cc4c8f9871a8763818700c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:26.363802 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74801f92-7865-4b96-8571-15bb90b9df69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bf0d01731f4923bc6dd8aa5741aa0d, user_id=71f9657236cc4c8f9871a8763818700c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:26.366471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74801f92-7865-4b96-8571-15bb90b9df69 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:26.448528 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1419/2877] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:26 2022] PUT /identity/v3/projects/60bf0d01731f4923bc6dd8aa5741aa0d/users/71f9657236cc4c8f9871a8763818700c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:26.452537 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff888-7a21-406e-8e7f-f385fe23aec3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:26.462533 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff888-7a21-406e-8e7f-f385fe23aec3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:26.519030 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb7cb3-07cc-4c50-8c2f-d6698b9f3c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:26.519743 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb7cb3-07cc-4c50-8c2f-d6698b9f3c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:26.520027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb7cb3-07cc-4c50-8c2f-d6698b9f3c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:26.520303 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb7cb3-07cc-4c50-8c2f-d6698b9f3c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:26.521088 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb7cb3-07cc-4c50-8c2f-d6698b9f3c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:26.522666 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb7cb3-07cc-4c50-8c2f-d6698b9f3c99 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:26.532343 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1459/2878] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:26.536455 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74801f92-7865-4b96-8571-15bb90b9df69 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:26.547134 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74801f92-7865-4b96-8571-15bb90b9df69 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:26.551835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c90c9-ccf3-4de5-a5f9-2a0090640c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:26.552997 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c90c9-ccf3-4de5-a5f9-2a0090640c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:26.553284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c90c9-ccf3-4de5-a5f9-2a0090640c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:26.553564 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c90c9-ccf3-4de5-a5f9-2a0090640c13 admin admin] PATH_INFO: `/v3/projects/60bf0d01731f4923bc6dd8aa5741aa0d/users/71f9657236cc4c8f9871a8763818700c/roles/ca945c946b2e4b67a9cba29a1f174f60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:26.555538 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c90c9-ccf3-4de5-a5f9-2a0090640c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bf0d01731f4923bc6dd8aa5741aa0d, user_id=71f9657236cc4c8f9871a8763818700c, role_id=ca945c946b2e4b67a9cba29a1f174f60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:26.558883 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c90c9-ccf3-4de5-a5f9-2a0090640c13 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:26.569112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1420/2879] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:26 2022] PUT /identity/v3/projects/60bf0d01731f4923bc6dd8aa5741aa0d/users/71f9657236cc4c8f9871a8763818700c/roles/ca945c946b2e4b67a9cba29a1f174f60 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:26.629259 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e801-78dc-4149-a335-224e54c25fef None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:26.629547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e801-78dc-4149-a335-224e54c25fef None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:26.629829 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e801-78dc-4149-a335-224e54c25fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:26.655398 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-51e5e801-78dc-4149-a335-224e54c25fef None None] MFA Rules not processed for user `71f9657236cc4c8f9871a8763818700c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:26.656621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-51e5e801-78dc-4149-a335-224e54c25fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:26.680113 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:26.723414 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1460/2880] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:26.735226 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c90c9-ccf3-4de5-a5f9-2a0090640c13 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:26.736951 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dc9c90c9-ccf3-4de5-a5f9-2a0090640c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:26.792334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c90c9-ccf3-4de5-a5f9-2a0090640c13 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:26.795941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f851-5665-478f-b336-a7f1c5462970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:26.796609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f851-5665-478f-b336-a7f1c5462970 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:26.796892 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f851-5665-478f-b336-a7f1c5462970 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:26.797166 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f851-5665-478f-b336-a7f1c5462970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:26.806376 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015f851-5665-478f-b336-a7f1c5462970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:26.807847 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015f851-5665-478f-b336-a7f1c5462970 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:26.816955 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1421/2881] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:27.170576 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e801-78dc-4149-a335-224e54c25fef None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:27.180361 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e801-78dc-4149-a335-224e54c25fef None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:27.184053 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a79033-e6e8-4f65-8bbc-7328b39ca861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:27.184727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a79033-e6e8-4f65-8bbc-7328b39ca861 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:27.185011 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a79033-e6e8-4f65-8bbc-7328b39ca861 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:27.185285 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a79033-e6e8-4f65-8bbc-7328b39ca861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:27.241652 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a79033-e6e8-4f65-8bbc-7328b39ca861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:27.243082 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a79033-e6e8-4f65-8bbc-7328b39ca861 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:27.251925 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1461/2882] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:33.828267 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f851-5665-478f-b336-a7f1c5462970 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:33.876876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:33.894007 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f851-5665-478f-b336-a7f1c5462970 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:33.899741 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:33.900905 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:33.901413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:33.901840 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] PATH_INFO: `/v3/users/53c69ab0c143416eaabb9c1c0458a82d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:33.903272 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c69ab0c143416eaabb9c1c0458a82d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:33.905711 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:34.169023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c69ab0c143416eaabb9c1c0458a82d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:34.176517 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c69ab0c143416eaabb9c1c0458a82d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:34.177193 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c69ab0c143416eaabb9c1c0458a82d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:34.189687 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c69ab0c143416eaabb9c1c0458a82d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:34.264742 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c69ab0c143416eaabb9c1c0458a82d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:34.271092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1422/2883] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:33 2022] DELETE /identity/v3/users/53c69ab0c143416eaabb9c1c0458a82d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:34.275639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a7ec8-92a8-4556-a236-c1619ad68c94 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:34.277895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a7ec8-92a8-4556-a236-c1619ad68c94 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:34.277895 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a7ec8-92a8-4556-a236-c1619ad68c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:34.293618 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ff6a7ec8-92a8-4556-a236-c1619ad68c94 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:34.294808 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ff6a7ec8-92a8-4556-a236-c1619ad68c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:34.351547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1462/2884] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:34.361006 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:34.362481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:34.419436 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a66fe2-da02-4c5d-86d3-aeb0aa3dfd5a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:34.422963 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a4e22-860c-4918-942c-262514c6e445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:34.423602 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a4e22-860c-4918-942c-262514c6e445 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:34.423888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a4e22-860c-4918-942c-262514c6e445 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:34.424167 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a4e22-860c-4918-942c-262514c6e445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:34.433345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a4e22-860c-4918-942c-262514c6e445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:34.435284 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a4e22-860c-4918-942c-262514c6e445 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:34.444593 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1423/2885] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:34.849348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a7ec8-92a8-4556-a236-c1619ad68c94 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:34.852753 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ff6a7ec8-92a8-4556-a236-c1619ad68c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:34.863153 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a7ec8-92a8-4556-a236-c1619ad68c94 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:34.867916 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:34.868815 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:34.869149 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:34.869417 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] PATH_INFO: `/v3/projects/ec394478981d4927b2e81898b24b117d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:34.870623 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec394478981d4927b2e81898b24b117d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:34.873246 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:34.996715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec394478981d4927b2e81898b24b117d', 'request_id': 'req-4c5edbfd-adae-4329-8cf5-47a181460102'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.000480 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:35.109074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec394478981d4927b2e81898b24b117d', 'request_id': 'req-4c5edbfd-adae-4329-8cf5-47a181460102'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.114679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec394478981d4927b2e81898b24b117d', 'request_id': 'req-4c5edbfd-adae-4329-8cf5-47a181460102'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.125978 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] The token cache is being invalidate because project ec394478981d4927b2e81898b24b117d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:35.126264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.126923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.128500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1463/2886] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:34 2022] DELETE /identity/v3/projects/ec394478981d4927b2e81898b24b117d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:35.136190 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a4e22-860c-4918-942c-262514c6e445 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:35.141876 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a4e22-860c-4918-942c-262514c6e445 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:35.197865 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:35.198737 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:35.199024 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:35.199318 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] PATH_INFO: `/v3/users/71f9657236cc4c8f9871a8763818700c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:35.200568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f9657236cc4c8f9871a8763818700c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:35.202511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:35.212454 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:35.346912 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f9657236cc4c8f9871a8763818700c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.353645 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f9657236cc4c8f9871a8763818700c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.354358 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f9657236cc4c8f9871a8763818700c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.366167 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f9657236cc4c8f9871a8763818700c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.435092 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c1a5cd89-c6b8-446d-bc19-f0ddaaa31127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f9657236cc4c8f9871a8763818700c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:35.441533 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1424/2887] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:35 2022] DELETE /identity/v3/users/71f9657236cc4c8f9871a8763818700c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:35.878579 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:35.880046 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:35.900044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5edbfd-adae-4329-8cf5-47a181460102 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:35.957162 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:35.958138 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:35.958422 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:35.958694 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] PATH_INFO: `/v3/projects/60bf0d01731f4923bc6dd8aa5741aa0d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:35.959851 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] RBAC: Authorizing `identity:delete_project(project_id=60bf0d01731f4923bc6dd8aa5741aa0d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:35.961785 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:36.098275 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60bf0d01731f4923bc6dd8aa5741aa0d', 'request_id': 'req-11b3f28b-2300-422e-8b44-ddbe919e307e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:36.185729 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60bf0d01731f4923bc6dd8aa5741aa0d', 'request_id': 'req-11b3f28b-2300-422e-8b44-ddbe919e307e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:36.191882 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60bf0d01731f4923bc6dd8aa5741aa0d', 'request_id': 'req-11b3f28b-2300-422e-8b44-ddbe919e307e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:36.202853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] The token cache is being invalidate because project 60bf0d01731f4923bc6dd8aa5741aa0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:36.205114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:36.205114 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-11b3f28b-2300-422e-8b44-ddbe919e307e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:36.205438 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1464/2888] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:35 2022] DELETE /identity/v3/projects/60bf0d01731f4923bc6dd8aa5741aa0d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:36.210229 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37b770-0a8d-416c-99e0-d2d52892801b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:36.210697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37b770-0a8d-416c-99e0-d2d52892801b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:36.210810 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37b770-0a8d-416c-99e0-d2d52892801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:36.228788 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9c37b770-0a8d-416c-99e0-d2d52892801b None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:36.233873 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9c37b770-0a8d-416c-99e0-d2d52892801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:36.287752 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1425/2889] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:36.295963 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4f5a5-ef66-4665-9f86-32cba9a8a51f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:36.296252 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4f5a5-ef66-4665-9f86-32cba9a8a51f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:36.296572 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4f5a5-ef66-4665-9f86-32cba9a8a51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:36.315081 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ffb4f5a5-ef66-4665-9f86-32cba9a8a51f None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:36.316267 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ffb4f5a5-ef66-4665-9f86-32cba9a8a51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:36.324178 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1465/2890] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:36.328115 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37b770-0a8d-416c-99e0-d2d52892801b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:36.337568 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37b770-0a8d-416c-99e0-d2d52892801b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:36.342111 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64daeb-b836-4a9d-9530-aac8ea91515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:36.342759 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64daeb-b836-4a9d-9530-aac8ea91515b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:36.343044 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64daeb-b836-4a9d-9530-aac8ea91515b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:36.343323 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64daeb-b836-4a9d-9530-aac8ea91515b admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:36.344047 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64daeb-b836-4a9d-9530-aac8ea91515b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:37:36.344392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64daeb-b836-4a9d-9530-aac8ea91515b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:36.346013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64daeb-b836-4a9d-9530-aac8ea91515b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:36.357752 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1426/2891] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 03:37:36.361799 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4f5a5-ef66-4665-9f86-32cba9a8a51f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:36.370989 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4f5a5-ef66-4665-9f86-32cba9a8a51f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:36.376326 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c70bf-da83-47df-b5e1-d1d2eb5515a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:36.376977 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c70bf-da83-47df-b5e1-d1d2eb5515a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:36.377264 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c70bf-da83-47df-b5e1-d1d2eb5515a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:36.377539 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c70bf-da83-47df-b5e1-d1d2eb5515a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:36.378227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c70bf-da83-47df-b5e1-d1d2eb5515a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:36.380106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c70bf-da83-47df-b5e1-d1d2eb5515a5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:36.504146 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1466/2892] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:36 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:37:36.508196 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64daeb-b836-4a9d-9530-aac8ea91515b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:36.518179 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64daeb-b836-4a9d-9530-aac8ea91515b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:36.573500 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab2de1-6a89-49cf-b100-97e887c1e5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:36.574154 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab2de1-6a89-49cf-b100-97e887c1e5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:36.574443 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab2de1-6a89-49cf-b100-97e887c1e5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:36.574750 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab2de1-6a89-49cf-b100-97e887c1e5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:36.575429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab2de1-6a89-49cf-b100-97e887c1e5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:36.577403 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab2de1-6a89-49cf-b100-97e887c1e5c5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:36.692930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1427/2893] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:36 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 03:37:36.697130 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c70bf-da83-47df-b5e1-d1d2eb5515a5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:36.707454 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c70bf-da83-47df-b5e1-d1d2eb5515a5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:36.712123 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a87e4d-cf0e-4d50-b55c-04a08f373172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:36.712810 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a87e4d-cf0e-4d50-b55c-04a08f373172 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:36.713106 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a87e4d-cf0e-4d50-b55c-04a08f373172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:36.713387 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a87e4d-cf0e-4d50-b55c-04a08f373172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:36.714202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a87e4d-cf0e-4d50-b55c-04a08f373172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:36.716290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a87e4d-cf0e-4d50-b55c-04a08f373172 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:36.726529 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1467/2894] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:36.730291 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab2de1-6a89-49cf-b100-97e887c1e5c5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:36.737191 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:36.740894 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab2de1-6a89-49cf-b100-97e887c1e5c5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:36.745790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11ada-8b94-403c-972e-87f9f8a4a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:36.746513 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11ada-8b94-403c-972e-87f9f8a4a9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:36.746805 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11ada-8b94-403c-972e-87f9f8a4a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:36.747094 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11ada-8b94-403c-972e-87f9f8a4a9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:36.747821 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11ada-8b94-403c-972e-87f9f8a4a9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:36.749502 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11ada-8b94-403c-972e-87f9f8a4a9d9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:36.760136 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1428/2895] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:36.764602 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a87e4d-cf0e-4d50-b55c-04a08f373172 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:36.774344 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a87e4d-cf0e-4d50-b55c-04a08f373172 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:36.779553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75166-44d1-4392-95b9-5c9ab434b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:36.780523 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75166-44d1-4392-95b9-5c9ab434b1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:36.780807 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75166-44d1-4392-95b9-5c9ab434b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:36.781109 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75166-44d1-4392-95b9-5c9ab434b1a3 admin admin] PATH_INFO: `/v3/projects/ee84d4fc22b4410299444feaf501c57b/users/49be426717ef4213bd1572f91baee777/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:36.800245 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d75166-44d1-4392-95b9-5c9ab434b1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee84d4fc22b4410299444feaf501c57b, user_id=49be426717ef4213bd1572f91baee777, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:36.803215 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d75166-44d1-4392-95b9-5c9ab434b1a3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:36.869984 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1468/2896] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:36 2022] PUT /identity/v3/projects/ee84d4fc22b4410299444feaf501c57b/users/49be426717ef4213bd1572f91baee777/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:36.890061 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13370f-d227-4e08-8262-b42a6be90fde None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:36.890353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13370f-d227-4e08-8262-b42a6be90fde None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:36.890631 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13370f-d227-4e08-8262-b42a6be90fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:36.916738 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0f13370f-d227-4e08-8262-b42a6be90fde None None] MFA Rules not processed for user `49be426717ef4213bd1572f91baee777`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:36.917944 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0f13370f-d227-4e08-8262-b42a6be90fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:36.981426 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1429/2897] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:36.992521 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75166-44d1-4392-95b9-5c9ab434b1a3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:37.000037 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f4d75166-44d1-4392-95b9-5c9ab434b1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:37.005278 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:37.051047 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75166-44d1-4392-95b9-5c9ab434b1a3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:37.055027 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47f6b9-51f5-4986-b9a9-53e49a4d2724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:37.055668 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47f6b9-51f5-4986-b9a9-53e49a4d2724 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:37.055952 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47f6b9-51f5-4986-b9a9-53e49a4d2724 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:37.056227 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47f6b9-51f5-4986-b9a9-53e49a4d2724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:37.064573 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47f6b9-51f5-4986-b9a9-53e49a4d2724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:37.065992 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47f6b9-51f5-4986-b9a9-53e49a4d2724 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:37.075944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1469/2898] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:37.100361 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13370f-d227-4e08-8262-b42a6be90fde None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:37.160663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13370f-d227-4e08-8262-b42a6be90fde None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:37.165217 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:37.166077 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:37.166360 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:37.166634 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] PATH_INFO: `/v3/users/49be426717ef4213bd1572f91baee777` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:37.167815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49be426717ef4213bd1572f91baee777)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:37.169809 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:37.392345 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49be426717ef4213bd1572f91baee777'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:37.399101 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49be426717ef4213bd1572f91baee777'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:37.399765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49be426717ef4213bd1572f91baee777'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:37.412009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49be426717ef4213bd1572f91baee777'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:37.476313 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49be426717ef4213bd1572f91baee777'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:37.483398 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1430/2899] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:37 2022] DELETE /identity/v3/users/49be426717ef4213bd1572f91baee777 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:37.487847 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093db22-f1c0-4712-be1d-626604d6d571 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:37.488166 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093db22-f1c0-4712-be1d-626604d6d571 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:37.488485 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093db22-f1c0-4712-be1d-626604d6d571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:37.505798 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e093db22-f1c0-4712-be1d-626604d6d571 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:37.506996 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e093db22-f1c0-4712-be1d-626604d6d571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:37.563528 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1470/2900] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:37.573225 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:37.575170 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:37.580490 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:37.631373 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028ebf-2702-47db-9d83-c8683ed45088 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:37.635015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892a7fe-537a-4f8a-be80-c382a16e6649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:37.635656 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892a7fe-537a-4f8a-be80-c382a16e6649 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:37.635941 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892a7fe-537a-4f8a-be80-c382a16e6649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:37.636220 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892a7fe-537a-4f8a-be80-c382a16e6649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:37.646004 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892a7fe-537a-4f8a-be80-c382a16e6649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:37.647560 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892a7fe-537a-4f8a-be80-c382a16e6649 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:37.657918 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1431/2901] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 03:37:38.049026 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093db22-f1c0-4712-be1d-626604d6d571 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:38.050522 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e093db22-f1c0-4712-be1d-626604d6d571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:38.064857 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093db22-f1c0-4712-be1d-626604d6d571 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:38.070000 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:38.070877 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.071161 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.071439 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] PATH_INFO: `/v3/projects/ee84d4fc22b4410299444feaf501c57b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.072679 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee84d4fc22b4410299444feaf501c57b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:38.075239 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:38.166881 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee84d4fc22b4410299444feaf501c57b', 'request_id': 'req-ea03ec36-7ca5-4720-99a1-a23d35d0418b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:38.230423 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee84d4fc22b4410299444feaf501c57b', 'request_id': 'req-ea03ec36-7ca5-4720-99a1-a23d35d0418b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:38.236338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee84d4fc22b4410299444feaf501c57b', 'request_id': 'req-ea03ec36-7ca5-4720-99a1-a23d35d0418b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:38.247828 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] The token cache is being invalidate because project ee84d4fc22b4410299444feaf501c57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:38.248116 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:38.248788 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea03ec36-7ca5-4720-99a1-a23d35d0418b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:38.250334 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1471/2902] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:38 2022] DELETE /identity/v3/projects/ee84d4fc22b4410299444feaf501c57b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:38.255431 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4a311-765f-4105-bbd5-e32c9dd686df None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.255723 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4a311-765f-4105-bbd5-e32c9dd686df None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.256001 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4a311-765f-4105-bbd5-e32c9dd686df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.274155 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7de4a311-765f-4105-bbd5-e32c9dd686df None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:38.275334 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7de4a311-765f-4105-bbd5-e32c9dd686df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:38.333712 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1432/2903] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:38.344639 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e17ca-37a8-46ba-9e8e-47b92c52f084 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.344931 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e17ca-37a8-46ba-9e8e-47b92c52f084 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.345208 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e17ca-37a8-46ba-9e8e-47b92c52f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.363664 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f41e17ca-37a8-46ba-9e8e-47b92c52f084 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:38.364885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f41e17ca-37a8-46ba-9e8e-47b92c52f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:38.373247 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1472/2904] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:38.377288 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4a311-765f-4105-bbd5-e32c9dd686df None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:38.386956 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4a311-765f-4105-bbd5-e32c9dd686df None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:38.391459 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69acab-eeaa-47e4-a2c1-0bc288ee728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:38.392107 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69acab-eeaa-47e4-a2c1-0bc288ee728c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.392429 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69acab-eeaa-47e4-a2c1-0bc288ee728c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.392980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69acab-eeaa-47e4-a2c1-0bc288ee728c admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.393425 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69acab-eeaa-47e4-a2c1-0bc288ee728c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 03:37:38.393735 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69acab-eeaa-47e4-a2c1-0bc288ee728c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:38.395386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69acab-eeaa-47e4-a2c1-0bc288ee728c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:38.406678 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1433/2905] 10.222.0.15 () {58 vars in 1152 bytes} [Thu May 26 03:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 03:37:38.410686 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e17ca-37a8-46ba-9e8e-47b92c52f084 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:38.420367 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e17ca-37a8-46ba-9e8e-47b92c52f084 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:38.424902 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ae6d-a237-43a7-8f58-d49876d4b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:38.425541 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ae6d-a237-43a7-8f58-d49876d4b662 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.425824 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ae6d-a237-43a7-8f58-d49876d4b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.426102 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ae6d-a237-43a7-8f58-d49876d4b662 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.426787 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338ae6d-a237-43a7-8f58-d49876d4b662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:38.428970 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338ae6d-a237-43a7-8f58-d49876d4b662 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:38.494350 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1473/2906] 10.222.0.15 () {60 vars in 1152 bytes} [Thu May 26 03:37:38 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:37:38.498715 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69acab-eeaa-47e4-a2c1-0bc288ee728c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:38.508949 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69acab-eeaa-47e4-a2c1-0bc288ee728c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:38.563765 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79a5b2-3f80-47dc-bc88-aa896b04c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:38.564462 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79a5b2-3f80-47dc-bc88-aa896b04c766 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.564747 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79a5b2-3f80-47dc-bc88-aa896b04c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.565023 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79a5b2-3f80-47dc-bc88-aa896b04c766 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.565713 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79a5b2-3f80-47dc-bc88-aa896b04c766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:38.567648 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79a5b2-3f80-47dc-bc88-aa896b04c766 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:38.671091 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1434/2907] 10.222.0.15 () {60 vars in 1143 bytes} [Thu May 26 03:37:38 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 03:37:38.675171 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ae6d-a237-43a7-8f58-d49876d4b662 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:38.685878 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ae6d-a237-43a7-8f58-d49876d4b662 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:38.690397 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8e680-62f0-4fb8-af80-ffdde8da8c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:38.691044 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e680-62f0-4fb8-af80-ffdde8da8c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.691323 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e680-62f0-4fb8-af80-ffdde8da8c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.691597 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e680-62f0-4fb8-af80-ffdde8da8c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.692424 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8e680-62f0-4fb8-af80-ffdde8da8c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:38.693988 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8e680-62f0-4fb8-af80-ffdde8da8c09 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:38.695189 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:38.704811 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1474/2908] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:38.708574 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79a5b2-3f80-47dc-bc88-aa896b04c766 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:38.718893 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79a5b2-3f80-47dc-bc88-aa896b04c766 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:38.723521 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c9144-3cea-479f-b178-9009c8541ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:38.724174 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9144-3cea-479f-b178-9009c8541ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.724498 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9144-3cea-479f-b178-9009c8541ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.727007 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9144-3cea-479f-b178-9009c8541ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.727007 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c9144-3cea-479f-b178-9009c8541ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:38.727209 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c9144-3cea-479f-b178-9009c8541ed2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:38.737553 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1435/2909] 10.222.0.15 () {58 vars in 1121 bytes} [Thu May 26 03:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 03:37:38.741429 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8e680-62f0-4fb8-af80-ffdde8da8c09 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:38.751547 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8e680-62f0-4fb8-af80-ffdde8da8c09 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:38.756142 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f8f24-d405-4dae-af95-92b5b4de7458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:38.757051 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8f24-d405-4dae-af95-92b5b4de7458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.757338 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8f24-d405-4dae-af95-92b5b4de7458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.757616 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8f24-d405-4dae-af95-92b5b4de7458 admin admin] PATH_INFO: `/v3/projects/c03a6e0e15664c7294292c007605e8e6/users/9f8d4616825048deb573db75decf1339/roles/64789f5937034a188d1774823d2387cb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.771885 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f8f24-d405-4dae-af95-92b5b4de7458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03a6e0e15664c7294292c007605e8e6, user_id=9f8d4616825048deb573db75decf1339, role_id=64789f5937034a188d1774823d2387cb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:38.775127 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f8f24-d405-4dae-af95-92b5b4de7458 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:38.847089 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1475/2910] 10.222.0.15 () {60 vars in 1482 bytes} [Thu May 26 03:37:38 2022] PUT /identity/v3/projects/c03a6e0e15664c7294292c007605e8e6/users/9f8d4616825048deb573db75decf1339/roles/64789f5937034a188d1774823d2387cb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:38.858014 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53350b13-f690-4162-ad97-cfd95af806fa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:38.858307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53350b13-f690-4162-ad97-cfd95af806fa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:38.858582 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53350b13-f690-4162-ad97-cfd95af806fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:38.877481 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:38.884790 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-53350b13-f690-4162-ad97-cfd95af806fa None None] MFA Rules not processed for user `9f8d4616825048deb573db75decf1339`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:38.886114 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-53350b13-f690-4162-ad97-cfd95af806fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:38.949082 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1436/2911] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:38.960348 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f8f24-d405-4dae-af95-92b5b4de7458 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:38.965781 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c00f8f24-d405-4dae-af95-92b5b4de7458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:39.020365 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f8f24-d405-4dae-af95-92b5b4de7458 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:39.023990 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48d08b-1a3e-47f6-a414-42d56454a3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e479d9969f534788b2f35685e4e28da8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:39.024672 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d08b-1a3e-47f6-a414-42d56454a3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:39.024960 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d08b-1a3e-47f6-a414-42d56454a3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:39.025236 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d08b-1a3e-47f6-a414-42d56454a3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:39.034147 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48d08b-1a3e-47f6-a414-42d56454a3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:39.035634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48d08b-1a3e-47f6-a414-42d56454a3f0 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:39.044440 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1476/2912] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:48.946242 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=27 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:49.040520 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:37:50.308815 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53350b13-f690-4162-ad97-cfd95af806fa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:50.368482 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53350b13-f690-4162-ad97-cfd95af806fa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:50.372969 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:50.373830 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:50.374112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:50.374386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] PATH_INFO: `/v3/users/9f8d4616825048deb573db75decf1339` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:50.375550 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8d4616825048deb573db75decf1339)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:50.377494 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:50.546015 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8d4616825048deb573db75decf1339'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:50.553125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8d4616825048deb573db75decf1339'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:50.553786 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8d4616825048deb573db75decf1339'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:50.565416 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8d4616825048deb573db75decf1339'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:50.629863 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8d4616825048deb573db75decf1339'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:50.636391 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1437/2913] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:37:50 2022] DELETE /identity/v3/users/9f8d4616825048deb573db75decf1339 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:37:50.641282 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad73c4-ad6b-4ec0-ad90-13cc16ea9e48 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:50.641754 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad73c4-ad6b-4ec0-ad90-13cc16ea9e48 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:50.641853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad73c4-ad6b-4ec0-ad90-13cc16ea9e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:50.660763 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bfad73c4-ad6b-4ec0-ad90-13cc16ea9e48 None None] MFA Rules not processed for user `5700cdd86bd44b43a6a74ec88a185c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 03:37:50.661950 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bfad73c4-ad6b-4ec0-ad90-13cc16ea9e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:50.719447 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1477/2914] 10.222.0.15 () {58 vars in 957 bytes} [Thu May 26 03:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 03:37:50.728877 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:50.730280 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:50.785322 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331133ac-d260-4be7-b052-5111eda96cca admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:50.789002 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb91fc-c0fd-4898-b152-349aa0b8a13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:50.789609 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb91fc-c0fd-4898-b152-349aa0b8a13c service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:50.789888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb91fc-c0fd-4898-b152-349aa0b8a13c service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:50.790163 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb91fc-c0fd-4898-b152-349aa0b8a13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:50.799511 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb91fc-c0fd-4898-b152-349aa0b8a13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:50.800930 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb91fc-c0fd-4898-b152-349aa0b8a13c service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:50.810577 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1438/2915] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:37:51.230038 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad73c4-ad6b-4ec0-ad90-13cc16ea9e48 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:37:51.231553 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bfad73c4-ad6b-4ec0-ad90-13cc16ea9e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:37:51.245634 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad73c4-ad6b-4ec0-ad90-13cc16ea9e48 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:37:51.250923 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:37:51.252486 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:37:51.252935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:37:51.253220 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] PATH_INFO: `/v3/projects/c03a6e0e15664c7294292c007605e8e6` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:37:51.254479 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03a6e0e15664c7294292c007605e8e6)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:37:51.256296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:37:51.379240 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03a6e0e15664c7294292c007605e8e6', 'request_id': 'req-b35c3ca3-091d-4d9a-9fca-0843addb8fba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:51.436296 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03a6e0e15664c7294292c007605e8e6', 'request_id': 'req-b35c3ca3-091d-4d9a-9fca-0843addb8fba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:51.442074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03a6e0e15664c7294292c007605e8e6', 'request_id': 'req-b35c3ca3-091d-4d9a-9fca-0843addb8fba'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:51.452944 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] The token cache is being invalidate because project c03a6e0e15664c7294292c007605e8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:37:51.453232 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:51.453853 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:37:51.455373 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1478/2916] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:37:51 2022] DELETE /identity/v3/projects/c03a6e0e15664c7294292c007605e8e6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:38:00.806342 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:38:01.449937 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:38:57.673937 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb91fc-c0fd-4898-b152-349aa0b8a13c service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:38:57.682895 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb91fc-c0fd-4898-b152-349aa0b8a13c service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:38:57.732012 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:38:57.732697 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:38:57.732984 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:38:57.733262 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:38:57.735039 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:38:57.744149 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:38:57.745606 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:38:57.754009 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1439/2917] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:38:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:39:01.816263 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:01.817715 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:01.830463 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c3ca3-091d-4d9a-9fca-0843addb8fba admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:01.834076 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:01.834716 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:01.835002 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:01.835281 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:01.836997 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:01.893737 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:01.895160 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:01.904631 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1479/2918] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:39:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:39:03.014319 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:03.015947 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:03.095870 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b307f-d237-4034-84af-5ab9e5a37416 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:03.102660 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d060d-ddac-44bb-926b-7e8d39d3e66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:03.104700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d060d-ddac-44bb-926b-7e8d39d3e66e service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:03.104700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d060d-ddac-44bb-926b-7e8d39d3e66e service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:03.104700 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d060d-ddac-44bb-926b-7e8d39d3e66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:03.105915 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2d2d060d-ddac-44bb-926b-7e8d39d3e66e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:03.119048 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d060d-ddac-44bb-926b-7e8d39d3e66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:03.120720 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d060d-ddac-44bb-926b-7e8d39d3e66e service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:03.133186 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1440/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:39:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:39:03.465228 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:03.467385 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:03.478276 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8f2a5-a81c-4104-9583-1b5b6f54cddc service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:03.481907 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb08f8-48d4-4b21-9342-991477040e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:03.485671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb08f8-48d4-4b21-9342-991477040e71 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:03.485671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb08f8-48d4-4b21-9342-991477040e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:03.485671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb08f8-48d4-4b21-9342-991477040e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:03.485671 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-90bb08f8-48d4-4b21-9342-991477040e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:03.499640 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb08f8-48d4-4b21-9342-991477040e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:03.501085 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb08f8-48d4-4b21-9342-991477040e71 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:03.512727 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1480/2920] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:39:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:39:04.689138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d060d-ddac-44bb-926b-7e8d39d3e66e service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:04.698279 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d060d-ddac-44bb-926b-7e8d39d3e66e service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:04.701959 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e82dad-5b9f-4b0b-a09d-655c956fae04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:04.702586 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e82dad-5b9f-4b0b-a09d-655c956fae04 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:04.702866 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e82dad-5b9f-4b0b-a09d-655c956fae04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:04.703140 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e82dad-5b9f-4b0b-a09d-655c956fae04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:04.705799 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-22e82dad-5b9f-4b0b-a09d-655c956fae04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:04.719835 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e82dad-5b9f-4b0b-a09d-655c956fae04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:04.721307 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e82dad-5b9f-4b0b-a09d-655c956fae04 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:04.732902 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1441/2921] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:39:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:39:05.605907 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb08f8-48d4-4b21-9342-991477040e71 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:05.617155 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb08f8-48d4-4b21-9342-991477040e71 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:05.622670 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f966be1d764324b7695e1caf578291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:05.623297 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:05.623577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:05.623848 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:05.625581 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:05.637477 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:05.639591 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:05.650023 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1481/2922] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:39:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:39:07.355691 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e82dad-5b9f-4b0b-a09d-655c956fae04 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:07.364527 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e82dad-5b9f-4b0b-a09d-655c956fae04 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:07.368159 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22fe8105f01400ab6ac3dc14c7aa7f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:07.368909 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:07.369112 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:07.369392 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:07.371264 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:07.435886 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:07.437387 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:07.446888 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1442/2923] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:39:10.652661 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:10.654643 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:10.723761 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e55e7-4707-48eb-8086-fc49b8c5a772 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:10.728726 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce32eb5-7983-4814-ac17-5ed19902f9be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:10.729372 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce32eb5-7983-4814-ac17-5ed19902f9be service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:10.729657 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce32eb5-7983-4814-ac17-5ed19902f9be service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:10.729935 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce32eb5-7983-4814-ac17-5ed19902f9be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:10.731725 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6ce32eb5-7983-4814-ac17-5ed19902f9be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:10.743454 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce32eb5-7983-4814-ac17-5ed19902f9be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:10.745167 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce32eb5-7983-4814-ac17-5ed19902f9be service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:10.754967 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1482/2924] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:39:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:39:14.284913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:14.286897 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:14.301495 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58645d-9a95-4775-922e-3527ca637652 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:14.306252 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:14.307125 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:14.307413 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:14.307696 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] PATH_INFO: `/v3/users/85778df2ce7b4e6696e2ffe163d47aca` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:14.308913 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=85778df2ce7b4e6696e2ffe163d47aca)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:14.310907 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:14.313370 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:39:14.490211 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85778df2ce7b4e6696e2ffe163d47aca'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:14.496993 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85778df2ce7b4e6696e2ffe163d47aca'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:14.498161 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85778df2ce7b4e6696e2ffe163d47aca'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:14.509957 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85778df2ce7b4e6696e2ffe163d47aca'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:14.568663 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85778df2ce7b4e6696e2ffe163d47aca'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:14.574666 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1443/2925] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:39:14 2022] DELETE /identity/v3/users/85778df2ce7b4e6696e2ffe163d47aca => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:39:14.806497 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce32eb5-7983-4814-ac17-5ed19902f9be service placement] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:14.819075 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce32eb5-7983-4814-ac17-5ed19902f9be service placement] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:14.877806 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:14.878682 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:14.879074 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:14.879362 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] PATH_INFO: `/v3/projects/45cfe981eb124baba9a0dd679eea36ee` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:14.880582 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45cfe981eb124baba9a0dd679eea36ee)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:14.882494 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:14.885046 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:39:14.964757 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cfe981eb124baba9a0dd679eea36ee', 'request_id': 'req-5792db9a-be55-417a-935f-5b3114ecc63f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.010200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cfe981eb124baba9a0dd679eea36ee', 'request_id': 'req-5792db9a-be55-417a-935f-5b3114ecc63f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.015887 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cfe981eb124baba9a0dd679eea36ee', 'request_id': 'req-5792db9a-be55-417a-935f-5b3114ecc63f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.026728 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] The token cache is being invalidate because project 45cfe981eb124baba9a0dd679eea36ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:39:15.027008 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.027621 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.029817 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1483/2926] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:39:14 2022] DELETE /identity/v3/projects/45cfe981eb124baba9a0dd679eea36ee => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:39:15.033867 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:15.035417 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:15.049120 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11699019-b631-4370-9659-57c8922e8b7b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:15.104116 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:15.105013 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:15.105299 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:15.105575 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] PATH_INFO: `/v3/users/d7e101e62eca400688363b5fb58f19a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:15.107386 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e101e62eca400688363b5fb58f19a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:15.109371 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:15.314895 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e101e62eca400688363b5fb58f19a4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.321471 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e101e62eca400688363b5fb58f19a4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.322126 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e101e62eca400688363b5fb58f19a4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.334068 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e101e62eca400688363b5fb58f19a4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.393117 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e101e62eca400688363b5fb58f19a4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.395353 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:39:15.399658 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1444/2927] 10.222.0.15 () {58 vars in 1223 bytes} [Thu May 26 03:39:15 2022] DELETE /identity/v3/users/d7e101e62eca400688363b5fb58f19a4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 03:39:15.627346 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:39:15.628841 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:39:15.642500 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792db9a-be55-417a-935f-5b3114ecc63f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:39:15.701404 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700cdd86bd44b43a6a74ec88a185c9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc9d186e27441d983463d38b1cc22e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:39:15.702262 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:39:15.702546 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:39:15.702820 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] PATH_INFO: `/v3/projects/a1897b8d2dec4070b1b093c0a65be862` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:39:15.703993 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1897b8d2dec4070b1b093c0a65be862)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:39:15.705924 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:39:15.827987 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1897b8d2dec4070b1b093c0a65be862', 'request_id': 'req-bc489989-4a09-441f-bf6d-8ef5e510a549'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.900341 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1897b8d2dec4070b1b093c0a65be862', 'request_id': 'req-bc489989-4a09-441f-bf6d-8ef5e510a549'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.906200 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1897b8d2dec4070b1b093c0a65be862', 'request_id': 'req-bc489989-4a09-441f-bf6d-8ef5e510a549'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.917290 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] The token cache is being invalidate because project a1897b8d2dec4070b1b093c0a65be862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 03:39:15.917577 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.918202 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bc489989-4a09-441f-bf6d-8ef5e510a549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 03:39:15.919731 dv-cinder-843361-1-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1484/2928] 10.222.0.15 () {58 vars in 1232 bytes} [Thu May 26 03:39:15 2022] DELETE /identity/v3/projects/a1897b8d2dec4070b1b093c0a65be862 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 03:39:25.914299 dv-cinder-843361-1-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=74,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 03:42:03.927057 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 03:42:03.928524 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:42:03.995450 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2427d9a-0356-45b8-a6eb-e4e328e7b261 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 03:42:04.053562 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe916c2-c2f2-4d7b-8eae-6a44188f22d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257d9a088fa04cd5af48d6e4fb8b2f0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0107b46167b4923b4bcec527390ec96', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 03:42:04.054138 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe916c2-c2f2-4d7b-8eae-6a44188f22d6 service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 03:42:04.054441 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe916c2-c2f2-4d7b-8eae-6a44188f22d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 03:42:04.054703 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe916c2-c2f2-4d7b-8eae-6a44188f22d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 03:42:04.056484 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0fe916c2-c2f2-4d7b-8eae-6a44188f22d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 03:42:04.067980 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe916c2-c2f2-4d7b-8eae-6a44188f22d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 03:42:04.069608 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe916c2-c2f2-4d7b-8eae-6a44188f22d6 service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 03:42:04.079298 dv-cinder-843361-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1445/2929] 10.222.0.15 () {60 vars in 1365 bytes} [Thu May 26 03:42:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 03:42:14.075078 dv-cinder-843361-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=58 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}